36sec snip

No Priors: Artificial Intelligence | Technology | Startups cover image

Google DeepMind's Vision for AI, Search and Gemini with Oriol Vinyals from Google DeepMind

No Priors: Artificial Intelligence | Technology | Startups

NOTE

Embrace the Infinite: Context Length is Expanding

The forthcoming advancement of infinite context length in AI models represents a significant shift from prior technologies that only simulated memory capacity. While earlier models like recurrent neural networks and LSTMs theoretically possessed infinite memory, their practical application remained limited, with effective memory extending to only a few hundred words. This evolution suggests a future where AI can truly encompass larger contexts, enhancing its capability and depth of understanding.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode