Talk Python To Me cover image

Talk Python To Me

#454: Data Pipelines with Dagster

Mar 21, 2024
58:25
Snipd AI
Explore data pipelines with Python using Dagster, featuring insights from Pedram Navid. Learn about building efficient data pipelines, orchestrating automation, optimizing deployments with Posit Connect, backfills, partitioning, and popular data tools like DBT, DuckDB, Apache Arrow, and Pollers.
Read more

Podcast summary created with Snipd AI

Quick takeaways

  • Dagster simplifies data pipeline creation by focusing on assets and resources for a declarative approach to data orchestration.
  • Dagster's asset-based approach allows for easy modeling and execution of pipelines with tracking of asset metadata over time for performance optimization.

Deep dives

Data Pipelines with Daxter

Daxter, a valuable tool for creating data pipelines with Python, was discussed in this podcast episode. Pedram Navied from Daxter Labs highlighted the significance of data pipelines in processing, filtering, and transforming external data for businesses. Using Daxter simplifies building pipelines by focusing on assets and resources, allowing for a more declarative and efficient approach to data orchestration.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode