Talk Python To Me cover image

#454: Data Pipelines with Dagster

Talk Python To Me

CHAPTER

Building Data Pipelines with Python and a User Interface

The chapter explores creating directed acyclic graphs (DAGs) for data pipelines by building assets, Python code, and a user interface in a workflow style. It emphasizes the importance of clear execution paths and dependencies in DAGs and materializing assets using Python functions. The discussion also covers emitting metadata, monitoring assets, benchmarking Python code, integrating with AWS, and leveraging Dijkstra for managing data pipelines efficiently.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner