
#204 Data & AI Trends in 2024, with Tom Tunguz, General Partner at Theory Ventures
DataFramed
Evolution of Data Quality and Introduction to Data Contracts
The modern AI stack is anticipated to be richer and more complex than the previous data stack. Data quality involves monitoring the flow of data, detecting changes in sources, distribution, volume, and shape of data. Tools like Monte Carlo and test-based approaches are utilized for understanding and ensuring data quality. Data contracts, akin to microservices in software engineering, entail declaring inputs, outputs, guarantees on performance to facilitate collaboration and data management in a decentralized data environment. This ensures that changes in data format are communicated effectively to prevent disruptions in downstream systems.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.