The Sequel Show cover image

Data Orchestration and Config as Code with Nick Shrock, Creator of Dagster

The Sequel Show

CHAPTER

ML Pipeline ETL

When you're building data applications, the kind of like these dependency graphs is such a fundamental primitive that you should be doing it from square one effect. You know, we view diacs for something that scales all the way from single player mode to full-blown ML pipeline ETL. We think that actually should be more of a primitive abstraction rather than to be something where only very late in the game, you decide like, oh, now we need to do orchestration.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner