
AI Frontiers: The Physics of AI with Sébastien Bubeck
Microsoft Research Podcast
00:00
The Limits of Deep Learning
Nobody, I think nobody in the world perhaps except open AI expected that intelligence would emerge from this next word prediction framework just on a lot of data. This is really crazy, if you think about it. In a way, you can say maybe there is no limitation to the next word, you know, prediction framework. The other perspective is no, no, actually the next word prediction token framework is very limiting, at least at generation time. At least once you start to generate new sentences, you should go beyond a little bit. If you want to have planning aspect, if you want to be able to revisit mistakes that you made.
Play episode from 22:59
Transcript


