2min chapter

The Data Stack Show cover image

70: The Difference Between Data Lakes and Data Warehouses with Vinoth Chandar of Apache Hudi

The Data Stack Show

CHAPTER

Is There a Gap in Lake House Architecture?

The lake has no servers for both data and metadata today. The way that we think so evolved with like Delta Lake or iceberg right where you stick metadata into a file. That's not going to be like performance if you compare to what let's say snowflake task which is like keep metadata in another world TV horizontally scalable old database like foundation, for example. We are trying to think of it a model where we have servers for metadata and we keep the data plane like kind of serverlesswhere in a spark jobs should be able to access the raw direct Right.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode