AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Do You Know How to Overfit on Your Validation Set?
I think the beauty of the situation now is that we have a lot more data, and what you can do is you can derive guarantees that are a lot more data adaptive. So by now, in order to get guarantees, you're much more willing to so cross validation is a simple example of that. But physically, don't overfit on your valudation set, or something like that. I mean, thereal cases where this is so for medical data, a thousand people having some rare diseases is a terrible thing. And the these are cases where you are happy that maybe the datar sas is small, because it means not so many people die.