Secrets of Data Analytics Leaders

It's not easy being the head of data & analytics at a large organization. You must align a large team across multiple disciplines; you must deal with oodles of legacy systems and tools that hamper innovation; and you must deliver business value fast to keep executives at bay and your job intact. You also need to recruit dynamic managers who can push the envelope while meeting operational objective...

Adopting community of practice principles, along with coaching and mentoring, is a practical approach to fostering and cultivating data literacy. Published at: https://www.eckerson.com/articles/a-people-first-approach-to-developing-data-literacy

This blog examines the upcoming trend of domain-specific LLMs and evaluates three different methods of implementation. Published at: https://www.eckerson.com/articles/the-next-wave-of-generative-ai-domain-specific-llms

Many machine learning (ML) use cases center on real-time calculations. This article defines streaming ML and its architectural components. Published at: https://www.eckerson.com/articles/machine-learning-and-streaming-data-pipelines-part-i-definitions-and-architecture

Companies need to invest heavily in teams and people, both at corporate and in the field, if they want to become a data-driven organization. Published at: https://www.eckerson.com/articles/organizing-for-success-part-iii-how-to-organize-and-staff-data-analytics-teams

Data management practices have changed substantially since the early 1990s and the dawn of data warehousing. Published at: https://www.eckerson.com/articles/the-continuing-evolution-of-data-management

Conventional data governance conflicts with today’s world of self-service analytics and agile projects. Published at: https://www.eckerson.com/articles/modern-data-governance-problems

Let's reflect on the events of the past year and prognosticate on what may transpire in the months ahead. Published at: https://www.eckerson.com/articles/trends-for-2024-our-team-gazes-into-the-crystal-ball

Data leaders must prepare their teams to deliver the timely, accurate, and trustworthy data that GenAI initiatives need to ensure they deliver results. They can do so by modernizing their environments, extending data governance programs, and fostering collaboration with data science teams. Published at: https://www.eckerson.com/articles/the-data-leader-s-guide-to-generative-ai-part-i-models-applic...

Data modeling is a core skill of data engineering, but it is missing or inadequate in many data engineering teams. These teams focus on moving data with little attention to shaping the data. They engineer processes, not products. Full data engineering is both process and product engineering, and that calls for data modeling. Published at: https://www.eckerson.com/articles/a-fresh-look-at-data-mode...

The hardest part about implementing data products is fostering a product mindset among the people responsible for defining, governing, building, and shipping data products. It’s also important that an organization establish processes to facilitate the work of the product team and review boards. Published at: https://www.eckerson.com/articles/data-products-part-ii-data-products-require-product-thin...

Many organizations abandoned data modeling as they embraced big data and NoSQL. Now they find that data modeling continues to be important, perhaps more important today than ever before. With a fresh look you’ll see that today’s data modeling is different from past practices – much more than physical design for relational data. Published at: https://www.eckerson.com/articles/a-fresh-look-at-data-m...

Data democratization is the buzzword to describe empowering enterprise stakeholders with data. While there have been advances in data management, governance, and analytics, something keeps getting in the way of achieving data democratization. Published at: https://www.eckerson.com/articles/data-democratization-and-the-duties-of-data-citizenship

Our industry’s breathless hype about generative AI tends to overlook the stubborn challenge of data governance. Data catalogs address this challenge by evaluating and controlling the accuracy, explainability, privacy, IP friendliness, and fairness of GenAI inputs. Published at: https://www.eckerson.com/articles/generative-ai-needs-vigilant-data-cataloging-and-governance

The need for an independent semantic layer continues to rise as data science gains traction in the enterprise. Its five primary elements—metrics, caching, metadata management, APIs, and access controls—support AI/ML use cases as part of data science projects. Published at: https://www.eckerson.com/articles/why-and-how-to-enable-data-science-with-an-independent-semantic-layer

Business leaders can address AI bias and use it to have rational discussions about management and human bias. Published at: https://www.eckerson.com/articles/weighing-the-risk-and-reward-of-ai-a-non-technical-guide-for-business-leaders

Most organizations view data as an asset to be actively managed with standards, controls, and discipline. Yet, they are passive and casual about metadata. Data is managed. Metadata happens. As data management becomes more complex, metadata management is becoming an essential discipline. It is time to think about metadata management from an architectural perspective. Published at: https://www.ecker...

Kevin Petrie, the Vice President of Research at Eckerson Group, and Dan O’Brien, research analyst, discussed large language models (LLMs), which are neural networks that analyze text to predict the next word or phrase. These models use training data, often from the internet, to understand word relationships and provide accurate answers to natural language questions.

Generative AI initiatives require new data pipelines that prepare text files for querying by language models. Data engineers, scientists, and other stakeholders collaborate to design and implement these pipelines, which span text sources, tokens, vectors, vector databases, and LMs. Published at: https://www.eckerson.com/articles/the-new-data-pipeline-for-generative-ai-where-and-how-it-works

Dan and Wayne discussed the concept of data and analytics operating models, which refers to how organizations organize their data and analytics resources for alignment and efficiency.

This final blog in our series on the ROI of master data management recommends ways for data teams to iterate their MDM initiatives based on the successes and failures of their first project. Published: https://www.eckerson.com/articles/driving-roi-with-master-data-management-part-iii-project-iteration

Responsible AI ethical principles provide a clear, unifying purpose for the technological, business, and social goals of AI initiatives. Published at: https://www.eckerson.com/articles/the-opportunity-and-risk-of-generative-ai-part-iii-responsible-ai-ethics

Most definitions of a data product conflate it with a data asset. The only way to turn a data asset into a data product is to publish it in a data store along with metadata about subscription and delivery options, and terms of service that specify a bidirectional contract between data consumer and producer. Published at: https://www.eckerson.com/articles/let-s-be-clear-a-data-asset-is-not-a-data-p...

Responsible AI can help data leaders comply with the fast-evolving regulatory environment of data and artificial intelligence. Published at: https://www.eckerson.com/articles/the-opportunity-and-risk-of-generative-ai-part-ii-how-responsible-ai-assists-compliance

US frontier history had races, risks, and rewards. Generative AI's future will follow a similar path. Published at: https://www.eckerson.com/articles/enterprise-data-and-the-taming-of-the-generative-ai-frontier