Software Engineering Radio - the podcast for professional software developers cover image

Episode 424: Sean Knapp on Dataflow Pipeline Automation

Software Engineering Radio - the podcast for professional software developers

00:00

How to Model a Data Pipeline?

The next era of orchestration is really around how do we actually have code and data aware orchestration. We are going to talk now more about automation, but proceeding that, let's talk a bit about how you model the pipelines. And that's where these directed acyclic graphs, DAGs come into play.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app