Data Lakehouses & Apache Iceberg

Oct 16, 2024

Dive into the world of data lakehouses and Apache Iceberg! Discover how these technologies streamline data management by reducing duplication and improving accessibility. Learn about the evolving landscape of hybrid data strategies and the critical role of data governance in optimizing large language models. Explore unique features of data lakehouse platforms that enhance team collaboration and performance. Plus, gain hands-on insights into leveraging Apache Iceberg for impactful analytics!

Ask episode

Chapters

Transcript

Episode notes

Intro

00:00 • 3min

The Rise of Data Lakehouses

02:46 • 14min

Navigating Hybrid Data Management for Cost Efficiency

17:09 • 3min

Exploring Data Lakehouse Platforms and Unified Analytics

19:49 • 2min

Streamlining Data Lakehouse Management for Optimal Performance

22:11 • 3min

Hands-On Exploration of Apache Iceberg and Data Lakehouses

25:26 • 3min

Alex Merced (@AMdatalakehouse, Senior Tech Evangelist, @dremio) talks about everything data and we dig deep into Apache Iceberg and DataLakehouses.

SHOW: 865

Want to go to All Things Open in Raleigh for FREE? (Oct 27th-29th)

We are offering 5 Free passes, first come, first serve for the Cloudcast Community -> Registration Link

Instructions:

Click reg link
Click “Get Tickets”
Choose ticket option
Proceed with registration (discount will automatically be applied, cost will be $0)

SHOW TRANSCRIPT: The Cloudcast #865 Transcript

SHOW VIDEO: https://youtube.com/@TheCloudcastNET

CLOUD NEWS OF THE WEEK: - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST: - "CLOUDCAST BASICS"

SHOW NOTES:

Dremio (homepage)
Hands-on with Apache Iceberg Tutorial
Apache Iceberg Crash Course
Data Lakehouses and Apache Hudi (Cloudcast Eps. 694)
Apache Iceberg, the Definitive Guide (eBook)
Apache Iceberg (homepage)
Iceberg + Nessie Catalog (homepage)
Iceberg + Polaris Catalog (homepage)
AlexMerced.com
DataLakehouseHub.com

Topic 1 - Welcome to the show. Tell us a little bit about your background.

Topic 2 - It’s been a little while since we talked about Data Lakehouses, can you give us a little bit of background on this space, and what the most recent dynamics are around these technologies.

Topic 3 - What are the typical integrations with a Data Lakehouse? How are users/developers typically interacting with Data Lakehouse technologies? [The marketplace for Iceberg catalogs like Nessie and Polaris]

Topic 4 - How does an open data format like Apache Iceberg fit into the bigger picture of data lakehouses, or large scale stores of data?

Topic 5 - How does Dremio enable Iceberg? How does Dremio sit in the intersection of Data Lakehouse, Data Mesh and Data Virtualization trends all of which come from the same fundamental problem, the growing scale of data use cases.

Topic 6 - We’ve seen companies start to rethink their data in the cloud strategies. Are you seeing on-premises making a comeback for large data applications

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @cloudcastpod
Instagram: @cloudcastpod
TikTok: @cloudcastpod