AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
3min chapter
Productionizing AI at LinkedIn
Practical AI: Machine Learning, Data Science, LLM
How to Monitor Your Machine Learning System for Future Failures
Google recently released a framework of machine learning test scores, which looks at the minimum score you could have gotten along either your feature monitoring feature health about your model monitoring and so on. That would be a first start to even figuring out with respect to if I made the health of something that is being deployed in production. And then there is all the choices that our models make, right? Like because we were going after a particular product objective. Now, what is the longer term impact that this may have overall in our user base? Is it going to be unfair to some segments of our population? "That's an even bigger ethical fairness question," he says.
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode