2min chapter

Data Driven cover image

Saket Saurabh on Automating Data Engineering

Data Driven

CHAPTER

The Importance of Schema Drift

I can't wait to see large language models integrated into that process because I suspect it'll do a much better job of managing that then trying to guess if you know what this data type should be in such. The way that the schema and educated guess about is this a one off thing and we should treat it as an error. That's part of our new approach, which will help us make more informed decisions on how best to work with your client’s data at any given time.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode