2min chapter

Hear This Idea cover image

#60 – Jaime Sevilla on Trends in Machine Learning

Hear This Idea

CHAPTER

What Scaling Laws Are Saying?

The relationship between performance and these inputs is surprisingly regular so far, such that if you just throw more compute and more data, then you get this like reliable improvement in performance. So we expect this kind of regularity can we somehow anticipate when are we going to see advancements in like other fields? This is more speculative. Got it. And then again, show us earlier, but you mentioned scaling yours. Can you write me exactly what scaling laws are saying? Yeah, so scaling laws are like this, this regularity between like the compute that is being used to train the system, the data that is used toTrain the System.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode