
Data Orchestration and Config as Code with Nick Shrock, Creator of Dagster
The Sequel Show
ML Pipeline ETL
When you're building data applications, the kind of like these dependency graphs is such a fundamental primitive that you should be doing it from square one effect. You know, we view diacs for something that scales all the way from single player mode to full-blown ML pipeline ETL. We think that actually should be more of a primitive abstraction rather than to be something where only very late in the game, you decide like, oh, now we need to do orchestration.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.