The Data T The Datapreneurs and the Future of Data and AI with Bob Muglia and Kent Graziano
Jul 17, 2023
Bob Muglia, former Microsoft exec and Snowflake CEO, and Kent Graziano, data industry technologist and evangelist, dive into the future of data and AI. They discuss how AI and large language models will transform the modern data stack and explore the evolution of data engineers into business engineers. Muglia shares insights on SQL's enduring relevance and knowledge graphs’ potential as semantic layers. They also touch on the importance of metadata, data governance, and envision a future with enhanced capabilities for large-scale data management.
AI Snips
Chapters
Books
Transcript
Episode notes
Five Platforms Shape The Modern Data Stack
- Five major platforms (Snowflake, Databricks, Microsoft, Amazon, Google) now dominate the modern data stack and converge on similar capabilities.
- Expect continued evolution toward data lake architectures, SQL-centric operations, and integrated ML/LLM features.
Make Access Control The Top Priority
- Prioritize consistent, coherent access control across data lakes to prevent governance chaos and protect privacy.
- Push vendors to standardize APIs for masking and column/row-level policies so governance applies uniformly.
Snowflake's Early Metadata Engineering
- Snowflake required tight control over metadata and data in its early design to avoid inconsistency at petabyte scale.
- Reliable cloud notifications (S3/Azure improvements) were crucial to enabling data-lake approaches.
