
Saket Saurabh on Automating Data Engineering
Data Driven
00:00
The Importance of Schema Drift
I can't wait to see large language models integrated into that process because I suspect it'll do a much better job of managing that then trying to guess if you know what this data type should be in such. The way that the schema and educated guess about is this a one off thing and we should treat it as an error. That's part of our new approach, which will help us make more informed decisions on how best to work with your client’s data at any given time.
Transcript
Play full episode