Super Data Science: ML & AI Podcast with Jon Krohn
825: Data Contracts: The Key to Data Quality, with Chad Sanderson
Oct 8, 2024
Chad Sanderson, CEO of Gable.ai and an expert in data quality and governance, shares insights on the transformative power of data contracts in modern data management. He explains how these contracts clarify expectations for data quality and promote better alignment between data producers and consumers. The conversation dives into 'shifting left' practices that tackle problems early, address concerns about data debt, and the crucial role of human oversight. Chad also highlights storytelling as a tool for data teams to enhance communication and effectiveness.
01:02:22
Episode guests
AI Summary
Highlights
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- Data contracts establish clear expectations for data quality and facilitate accountability between producers and consumers, enhancing overall data reliability.
- Shifting data quality checks closer to production enables proactive issue detection and fosters collaboration among data teams in governance practices.
Deep dives
Understanding Data Contracts
Data contracts are formal agreements between data producers and consumers, addressing persistent data quality and governance challenges. They define expectations related to data schema, quality, and semantics, similar to service contracts used in software engineering. The podcast emphasizes how data contracts facilitate clearer communication and accountability between data teams, thus improving data reliability. This structured approach aims to minimize the disruption caused by changes in data, such as modifications in formats or omitted fields.
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
