2min chapter

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) cover image

Multi-Device, Multi-Use-Case Optimization with Jeff Gehlhaar - #587

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

CHAPTER

Is Mixed Precision Getting Widely Used?

I would say that there's been a period of exploration the same maybe the last product cycle where we enabled it in our products, but again a little bit sort of to the necessary. There weren't good tools to sort of automate it so it was a way to address point problems. Oh this layer is having a problem quantizing or we need more output resolution hereso we're going to use a higher precision layer which produces higher resolution activations. Now we're introducing automatic mixed precision and bridging that friction points from taking a model that works great on a bench somewhere for data scientists and getting it onto device.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode