Open Lineage and Data Kin

Julien has a unique history of building open frameworks that make data platforms interoperable. He’s contributed in various ways to Apache Arrow, Apache Iceberg, Apache Parquet, and Marquez, and is currently leading OpenLineage, an open framework for data lineage collection and analysis.

In this episode, Tristan & Julia dive into how open source projects grow to become standards, and why data lineage in particular is in need of an open standard.

They also cover into some of the compelling use cases for this data lineage metadata, and where you might be able to deploy it in your work.

For full show notes and to read 6+ years of back issues of the podcast's companion newsletter, head to https://roundup.getdbt.com. 

The Analytics Engineering Podcast is sponsored by dbt Labs.