
171: Machine Learning Pipelines Are Still Data Pipelines with Sandy Ryza of Dagster
The Data Stack Show
DAGs and Data Assets in Data Pipelines
This chapter explores the concept of DAGs (Directed Acyclic Graphs) and how they are used in data pipelines. It discusses the differences between task-based systems and asset-based systems, emphasizing the advantages of using data assets as the central abstraction. The chapter also provides examples of building data pipelines using data assets and explains how users interact with DAGs through a Python API.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.