4min chapter

MLOps.community  cover image

Data Engineering for ML // Chad Sanderson // Coffee Sessions #117

MLOps.community

CHAPTER

The Core of Your Question Is Lineage

The problem with most lineage systems today is that it's just metadata collected off of the warehouse. If you do have some sort of lineage component, if you went that one additional step, it actually becomes an order of magnitude more valuable for like three different reasons. The other thing is there's not really the idea of a backwards incompatible change when you're managing database changes. There's the idea that change sort of within the service, but not within what's going to happen to all the consumers of this.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode