E01: Data Orchestration w/ Nick Schrock

Get an update from Nick Schrock on the dagster project. This episode discusses the world of data orchestration at large, when and how to implement dagster, and the broader competitive landscape.

Highlights:
[0:34] The Dagster project and the problems it solves
[3:05] Software defined assets and how they work 
[4:55] Example of how this can be implemented 
[6:30] Promotion of Dagster pipelines from development to production
[10:34] Dagster cloud overview 
[13:15] When to adopt a data orchestrator 
[14:23] Will data orchestration be subsumed into larger data platforms or remain standalone? 
[18:10] The competitive landscape of data orchestration

--

Mark your calendars for May 12-14, 2026 and join us for Data Council AI, the technical conference built by engineers for engineers. It's the only event where you'll be able to connect with 2,000+ practitioners for 3 full days of technical deep dives, battle-tested architectures and production insights in San Francisco, the heart of the AI world.

Visit us at https://www.datacouncil.ai/ for the latest updates or subscribe to the newsletter as we release more details about the 2026 event!