Decoding the Chess Moves of Snowflake and Databricks
Jun 22, 2024
auto_awesome
Exploring the shift in control over data estates and the importance of governance catalogs; Evolution of data products and governance in tech industry; Forecasting and planning agents in business operations; Evolution of semantic layer and vendor strategies in technology
37:19
AI Summary
AI Chapters
Episode notes
auto_awesome
Podcast summary created with Snipd AI
Quick takeaways
Move towards open data models with control shifting to governance catalogs.
Databricks focusing on enhancing interoperability and offering sophisticated AI toolchain for business outcomes.
Deep dives
Shifting Data Platforms Landscape
The podcast discusses the evolving trend towards open data models where firms maintain control of their data and can bring any compute engine to their data platforms. The move towards open table formats is gaining traction, shifting the point of control in data platforms from databases to governance catalogs.
Advancements in Analytic Systems
Data platforms are now evolving to become tools for analytic systems to drive business outcomes. The focus is on enabling intelligent applications that leverage governance catalogs to combine various data types and analytics while promoting open access and tool chains.
The Battle Between Snowflake and Databricks
Snowflake and Databricks are engaged in a technical and philosophical battle for dominance in the data platform space. Databricks' acquisition of Tabular, founded by creators of Iceberg, signifies a strategic move towards enhancing interoperability between Delta and Iceberg formats.
The Importance of Mosaic AI Acquisition
The acquisition of Mosaic ML by Databricks for around $1.3 billion has significantly contributed to offering Mosaic AI, a sophisticated toolchain for building compound systems of models. This toolchain aims to optimize how specialized models work together to drive business outcomes and enable continuous model improvement.