Conventional data governance conflicts with today’s world of self-service analytics and agile projects. Published at: https://www.eckerson.com/articles/modern-data-governance-problems

Let's reflect on the events of the past year and prognosticate on what may transpire in the months ahead. Published at: https://www.eckerson.com/articles/trends-for-2024-our-team-gazes-into-the-crystal-ball

This podcast explores the introduction of Generative AI and its impact on early adopters, covering the benefits and challenges faced. It discusses the process of fine-tuning a pre-trained Language Model on domain-specific language and facts. It also explores the application of Gen AI in industries such as travel booking, software development, and healthcare. Additionally, it discusses the responsibilities of data teams in managing data pipelines for Generative AI and the importance of preparing teams for successful Gen AI initiatives.

Data modeling is a core skill of data engineering, but it is missing or inadequate in many data engineering teams. These teams focus on moving data with little attention to shaping the data. They engineer processes, not products. Full data engineering is both process and product engineering, and that calls for data modeling. Published at: https://www.eckerson.com/articles/a-fresh-look-at-data-modeling-part-2-rediscovering-the-lost-art-of-data-modeling

The hardest part about implementing data products is fostering a product mindset among the people responsible for defining, governing, building, and shipping data products. It’s also important that an organization establish processes to facilitate the work of the product team and review boards. Published at: https://www.eckerson.com/articles/data-products-part-ii-data-products-require-product-thinking

Many organizations abandoned data modeling as they embraced big data and NoSQL. Now they find that data modeling continues to be important, perhaps more important today than ever before. With a fresh look you’ll see that today’s data modeling is different from past practices – much more than physical design for relational data. Published at: https://www.eckerson.com/articles/a-fresh-look-at-data-modeling-part-1-the-what-and-why-of-data-modeling

Data democratization is the buzzword to describe empowering enterprise stakeholders with data. While there have been advances in data management, governance, and analytics, something keeps getting in the way of achieving data democratization. Published at: https://www.eckerson.com/articles/data-democratization-and-the-duties-of-data-citizenship

Our industry’s breathless hype about generative AI tends to overlook the stubborn challenge of data governance. Data catalogs address this challenge by evaluating and controlling the accuracy, explainability, privacy, IP friendliness, and fairness of GenAI inputs. Published at: https://www.eckerson.com/articles/generative-ai-needs-vigilant-data-cataloging-and-governance

The need for an independent semantic layer continues to rise as data science gains traction in the enterprise. Its five primary elements—metrics, caching, metadata management, APIs, and access controls—support AI/ML use cases as part of data science projects. Published at: https://www.eckerson.com/articles/why-and-how-to-enable-data-science-with-an-independent-semantic-layer

Business leaders can address AI bias and use it to have rational discussions about management and human bias. Published at: https://www.eckerson.com/articles/weighing-the-risk-and-reward-of-ai-a-non-technical-guide-for-business-leaders