4min chapter

Data Driven cover image

Saket Saurabh on Automating Data Engineering

Data Driven

CHAPTER

Continuous Metadata Intelligence

The idea, the automated error management and quarantine I'm just kind of going from the bottom up here on the page for data operations. You take one, and you apply some operations to the output is another next set which is identical in behavior and consistency but it is a slightly different view of the data. The interesting thing is that these are all very importantly these, these next sets of data products are logical entities. They're not making copies of data so they're bringing the same sort of benefits that containerization has done on the compute side.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode