AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How to Train a Model That Doesn't Work in the Real World
There is big risk that you can end up training a model that looks really good before it hits production. And then when it hits production, when it gets deployed to a real device, it doesn't work very well. That's obviously a risk in all of data science, but it's especially amplified here because we've got less feedback loops between development and duction. So one of the things that you can do is periodically send people out to capture more data and test your model against that. But even if you can't afford to save all the raw sente data, you can potentially afford to save the output of the model. If the distributions of the output are changing a lot over time