The Sequel Show cover image

Data Orchestration and Config as Code with Nick Shrock, Creator of Dagster

The Sequel Show

00:00

ML Pipeline ETL

When you're building data applications, the kind of like these dependency graphs is such a fundamental primitive that you should be doing it from square one effect. You know, we view diacs for something that scales all the way from single player mode to full-blown ML pipeline ETL. We think that actually should be more of a primitive abstraction rather than to be something where only very late in the game, you decide like, oh, now we need to do orchestration.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app