AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How to Model a Data Pipeline?
The next era of orchestration is really around how do we actually have code and data aware orchestration. We are going to talk now more about automation, but proceeding that, let's talk a bit about how you model the pipelines. And that's where these directed acyclic graphs, DAGs come into play.