AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Statistical Fingerprinting - A Very Interesting Way to Reduce Problem Space
If you're looking at two different data sources and one of those data sources suddenly starts reporting currency in cents and the other one continues to report in dollars, that seems like a drift. How do you get out of your model drifting because your currency is in two different forms right now? And how quickly can you act on that? So depending on where you're putting these guardrails, if you're putting them as part of your model training process, what you can do is first of all doing some sort of distant test like KSTest or KL divergent test. Those are very common, but you do need to capture the distribution in order to calculate this. But in general, it