E01: Data Orchestration w/ Nick Schrock

Get an update from Nick Schrock on the dagster project. This episode discusses the world of data orchestration at large, when and how to implement dagster, and the broader competitive landscape.

Highlights:
[0:34] The Dagster project and the problems it solves
[3:05] Software defined assets and how they work 
[4:55] Example of how this can be implemented 
[6:30] Promotion of Dagster pipelines from development to production
[10:34] Dagster cloud overview 
[13:15] When to adopt a data orchestrator 
[14:23] Will data orchestration be subsumed into larger data platforms or remain standalone? 
[18:10] The competitive landscape of data orchestration

--

Thank you to everyone who made Data Council 2025 Oakland an incredibly experience! This year's talk videos will be uploaded to YouTube by end of May 2025.

Subscribe to our newsletter to get updates for once they're ready to view!