
Data Orchestration and Config as Code with Nick Shrock, Creator of Dagster
The Sequel Show
00:00
Is It a DAG or a Data Orchestration Topology?
A dependency graph that can be visualized prior to computation is actually an extremely useful documentation artifact. And so if I go back to something you said at the beginning of this conversation, which is these data orchestration topologies are themselves a software artifact. Then why should it not be in a full quote-unquote complete programming language? Rather than in a... DAG structure, for example?" "It's a great question. Yeah. I like that we've landed on practically a research topic it's good," he says. 'I don't think I've ever systematically gone through and missed all this stuff' He continues: 'There's one really strong argument today for why we should stick
Transcript
Play full episode