The Data Scientist Show - Daliana Liu cover image

How he carved his own path at Airbnb, from data engineer to CEO of Mage - Tommy Dang - the data scientist show #056

The Data Scientist Show - Daliana Liu

00:00

Building Data Pipelines in Mage - A Modern Replacement for Airflow

Mage is a data pipeline engine that we built to power thousands of pipelines running models, building training sets for Mage. We took a lot of our learnings working on data and airflow at Airbnb as part of the design process. The first one was an easy developer experience. Another one is engineering best practices built in. And another way we have engineeringbest practices built in is observability.

Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner
Get the app