Microsoft Research Podcast cover image

AI Frontiers: The Physics of AI with Sébastien Bubeck

Microsoft Research Podcast

00:00

The Limits of Deep Learning

Nobody, I think nobody in the world perhaps except open AI expected that intelligence would emerge from this next word prediction framework just on a lot of data. This is really crazy, if you think about it. In a way, you can say maybe there is no limitation to the next word, you know, prediction framework. The other perspective is no, no, actually the next word prediction token framework is very limiting, at least at generation time. At least once you start to generate new sentences, you should go beyond a little bit. If you want to have planning aspect, if you want to be able to revisit mistakes that you made.

Play episode from 22:59
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app