2min chapter

MLOps.community  cover image

The Long Tail of ML Deployment // Tuhin Srivastava // MLOps Podcast #161

MLOps.community

CHAPTER

The Importance of Knowledge Distillation

The idea is to create generalized models that can be used for solving problems at a higher level. The first question you're gonna almost make is like, is there an objective truth here? And then the secondary question is like, what do I need to do to solve this? Maybe it's maybe like you need this response within 100 milliseconds, and you need to, and you don't want it to be very, very expensive because it's happening every three or four seconds. You're gonna have to get a smaller, more concentrated model. But I think intuitively, that that seems right.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode