
#454: Data Pipelines with Dagster
Talk Python To Me
Building Data Pipelines with Python and a User Interface
The chapter explores creating directed acyclic graphs (DAGs) for data pipelines by building assets, Python code, and a user interface in a workflow style. It emphasizes the importance of clear execution paths and dependencies in DAGs and materializing assets using Python functions. The discussion also covers emitting metadata, monitoring assets, benchmarking Python code, integrating with AWS, and leveraging Dijkstra for managing data pipelines efficiently.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.