Talk Python To Me cover image

#454: Data Pipelines with Dagster

Talk Python To Me

00:00

Building Data Pipelines with Python and a User Interface

The chapter explores creating directed acyclic graphs (DAGs) for data pipelines by building assets, Python code, and a user interface in a workflow style. It emphasizes the importance of clear execution paths and dependencies in DAGs and materializing assets using Python functions. The discussion also covers emitting metadata, monitoring assets, benchmarking Python code, integrating with AWS, and leveraging Dijkstra for managing data pipelines efficiently.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app