AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
2min chapter
EP 31 Noam Shazeer - Google veteran and AI inventor on future of AI
The Aarthi and Sriram Show
How to Build a Probabilistic Model?
As models have gotten bigger and better, the early relatively small models would mostly get the grammar right. But as you start making them bigger and training them more and making them better in various ways, then they start okay being like perfect the grammar but getting a lot of facts wrong. It's maybe it is a lot like a child learning that at the beginning, you know, like if you have like a very, very weak model, it'll put together letters that seem to make sense and dabble or something. And then at some point it'll get the grammar mostly right. As the computing power goes up, so does the amount of training in the size of the model go up.
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode