4min chapter

Hear This Idea cover image

#60 – Jaime Sevilla on Trends in Machine Learning

Hear This Idea

CHAPTER

Is There an Absolute Measuring of Performance Improvement?

The amount of computers being used to train machine learning systems is around 10 to the 24 floating political operations. That's like the biggest systems that we have today have been trained on around that month of compute. We're seeing many orders of magnitude's worth of improvement with doubling times between like six months in the year, right? You're just going to get that very quickly. Presumably that doesn't translate to orders of magnitude of improvement on kind of common sense measures of performance, right? Because that would be insane. But this is a misleading way of looking about it in a sense. For some of the, for some of these metrics, you're going to find that there is like a smooth

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode