The Joe Reis Show Freestyle Fridays - Next-Generation Data Architectures. Ramblings and Speculations.
Jun 13, 2025
Explore the fascinating evolution of data architectures as the speaker reflects on insights from recent conferences. Discover how AI is reshaping data operations and the transition from isolated applications to unified platforms. Delve into the implications of rising interest rates and the competition in data processing frameworks, all while emphasizing the need for simpler engineering solutions. It's a compelling journey through the future of data management!
AI Snips
Chapters
Books
Transcript
Episode notes
Conference Anecdote in San Francisco
- Joe Reis spent two weeks attending big data conferences in San Francisco, feeling the city and conference center like home.
- He familiarized himself with local spots and the grocery store, showing how travel routines form quickly during events.
Evolution of Modern Data Stack
- The modern data stack peaked around 2020-2021 focused on democratizing data engineering stages.
- It involved many specialized SaaS tools, but interoperability was lacking among them.
Lakehouse Storage Winners and Future Battles
- Data lakehouse formats like Iceberg appear to be winning the storage standard battle.
- Future competition will shift to query engines and higher-level services as storage standardizes.
