17min chapter

The Data Stack Show cover image

171: Machine Learning Pipelines Are Still Data Pipelines with Sandy Ryza of Dagster

The Data Stack Show

CHAPTER

Orchestrating ML and Data Processing Pipelines

This chapter explores different orchestrators in the ML and data processing world, their differences, and their impact on the data pipeline ecosystem. The importance of a unified orchestration framework and the challenges of having multiple tools are discussed. The comparison between orchestrating ML work and orchestrating data engineering or analytical work is also highlighted.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode