The Importance of Correlation in Data Validation

The main problem is it's really hard to specify. And then you get a lot of alerts that don't make sense. So we found two big causes. One is temporal patterns, and often data validation techniques may collect temporal patterns. The second cause was that ML pipelines can have a lot of correlated features.

Transcript

Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.

Best podcast app

JD Stuart

App Store

I’ve been using Snipd for about a year and this app has been life changing. I listen to about 17 hours of podcasts a week and I want to take notes on 95% of them. Snipd makes it so easy to do. I can triple click my headphones and record a snip. The app also improves rapidly which is welcomed. It’s an easy subscription for me to pay.

🤯 How amazing is this app?!

Sophie

App Store

Snipd helps me keep track of everything I resonated with from a show. I can always find my snips, listen to them again, share them. And there are so many great product updates regularly! Like the feature to chat with the episode: I can retrieve even more knowledge from an episode 🥹 I’m in love with this app 🤍