AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
2min chapter
Eric Michaud on scaling, grokking and quantum interpretability
The Inside View
The Messier Scaling Exponents of Open AI in the Wild
So are you saying that the maybe the experiments in Chile, don't fit with your like risk payments or your theory? No, so I guess like we would expect that like the data scaling exponent is going to be less than the parameter scaling exponent. And this is like indeed what they observed in like the Chinchilla scaling law studies. So it seems like somewhat encouraging but if you actually look at like the precise value of like what these like scaling exponents are it's sort of like not exactly what we would predict.
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode