AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
3min chapter
What, if anything, do AIs understand? (with ChatGPT Co-Creator Ilya Sutskever)
Clearer Thinking with Spencer Greenberg
The Future of AI Systems
I think this is one area where humans and the human brain operates differently from our neural networks. So maybe we're confused about this idea that memorization is a bad thing just because in early AI systems, it happened to often show that you had not trained properly but it's not inherently a problem. Perhaps it is possible to do better than just memorizing everything. But my statement is different. My statement is that the gold standard formalism of generalization or at least a gold standard formalist, Bayesian inference is very consistent with you memorize everything yet you fully generalize. That's really interesting. We've talked about how these systems work. I want to now switch and talk about
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode