The Data Stack Show cover image

171: Machine Learning Pipelines Are Still Data Pipelines with Sandy Ryza of Dagster

The Data Stack Show

CHAPTER

DAGs and Data Assets in Data Pipelines

This chapter explores the concept of DAGs (Directed Acyclic Graphs) and how they are used in data pipelines. It discusses the differences between task-based systems and asset-based systems, emphasizing the advantages of using data assets as the central abstraction. The chapter also provides examples of building data pipelines using data assets and explains how users interact with DAGs through a Python API.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner