Catalog & Cocktails: The Honest, No-BS Data Podcast Data Contracts, Data Products, Data Mesh with Jean-Georges Perrin
Mar 20, 2025
Jean-Georges Perrin, an expert in data governance and data mesh from the Linux Foundation, joins Tim and Juan for an enlightening discussion. They dive deep into the essence of data contracts and their crucial role in shaping successful data products. The trio explores the evolution of data governance, emphasizing the need for skilled professionals in this field. With humor, they tackle challenges in modern data engineering and the balance of centralization and decentralization, offering insights on navigating information overload through collaboration.
AI Snips
Chapters
Books
Transcript
Episode notes
Data Contracts Define Clear Expectations
- Data contracts serve as agreements between data producers and consumers, detailing data expectations and quality.
- They form the backbone for successful data products, providing clear documentation and enforceable standards.
Begin Simple, Iterate Contracts
- Start with simple data contracts including schema and minimal documentation.
- Iterate by adding data quality rules, SLAs, and ownership as product maturity grows.
PayPal's Early Data Contract Story
- At PayPal, Jean-Georges helped develop an initial data contract standard ensuring consistency.
- They later open sourced it as it was vital but not a strategic secret for the company.
