Software Engineering Daily cover image

Software Engineering Daily

Iceberg at Netflix and Beyond with Ryan Blue

Mar 7, 2024
47:37
Snipd AI
Discover the origin and benefits of Apache Iceberg, a format for managing big data tables efficiently. Learn about Iceberg's collaboration with industry giants like Apple, Airbnb, and Lyft. Dive into the challenges of data migration and schema evolution in the realm of data management with Iceberg.
Read more

Podcast summary created with Snipd AI

Quick takeaways

  • Apache Iceberg simplifies big data analysis by enabling SQL tables usage with Spark and Hive concurrently.
  • Iceberg ensures correctness and efficiency by providing atomic operations for schema management and file layout enhancements.

Deep dives

Overview of Apache Iceberg and its Origins

Apache Iceberg is an open-source high-performance format for huge data tables born out of Netflix by Ryan Blue and Dan Weeks. It facilitates SQL table use for big data, enabling engines like Spark and Hive to work safely with the same tables concurrently. Since being open-sourced, companies like Airbnb, Apple, and Lyft have adopted Iceberg.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode