Google DeepMind's Vision for AI, Search and Gemini with Oriol Vinyals from Google DeepMind
No Priors: Artificial Intelligence | Technology | Startups
Embrace the Infinite: Context Length is Expanding
The forthcoming advancement of infinite context length in AI models represents a significant shift from prior technologies that only simulated memory capacity. While earlier models like recurrent neural networks and LSTMs theoretically possessed infinite memory, their practical application remained limited, with effective memory extending to only a few hundred words. This evolution suggests a future where AI can truly encompass larger contexts, enhancing its capability and depth of understanding.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
