AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Software Engineering Radio - the podcast for professional software developers
Episode 456: Tomer Shiran on Data Lakes
Apr 21, 2021
48:15
Snipd AI
Tomer Shiran, co-founder of Dremio, talks about managing data inside a data lake, historical changes and motivations for managing data as a data lake, and the common tools and methods for ingestion, storage, and analytics on top of the underlying data.
Read more
AI Summary
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- Data lakes provide a scalable and cost-effective solution for storing and ingesting large volumes of data into a centralized repository.
- The evolution of data storage formats in data lakes, such as the transition to column-oriented formats, has improved performance and query response times.
Deep dives
The Evolution of Data Warehouses
Data warehouses emerged as a centralized solution for analyzing data from multiple sources. Originally, data warehouses were created using the same technology as operational databases, but they provided a separate space for analysis to avoid impacting the performance of operational systems.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode