4min chapter

The Data Stack Show cover image

120: Materialize Origins: A Timely Dataflow Story with Arjun Narayan and Frank McSherry

The Data Stack Show

CHAPTER

How to Reduce the Life Cycle of Data in a Traditional Clouds Warehouse

The goal for short material is to let people take their existing business logic and transport those into materialize without much friction. Materialize users may be using dbt models to do the staged pipeline creation in snowflake. They have this incremental mode that they will attempt to go and I believe they require you to write the incremental version of your SQL query, which is fraught with problems. But there's a materialize dbt driver that will just say, like, you know what, you don't actually need to do anything. Just, we will keep your query running for you.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode