"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

2028 AGI, New Architectures, and Aligning Superhuman Models with Shane Legg, Deepmind Founder, on The Dwarkesh Podcast

32 snips
Jan 4, 2024
Shane Legg, Co-founder and Chief AGI Scientist at DeepMind, delves into the timeline for Artificial General Intelligence (AGI) and the new architectures required to achieve it. He discusses the challenges of measuring AI progress, particularly regarding human-like episodic memory. The conversation highlights DeepMind's diverse research initiatives, the importance of ethical reasoning in AI alignment, and a future shift toward multimodal capabilities, revolutionizing how AI interacts with different types of data.
Ask episode
AI Snips
Chapters
Transcript
Episode notes
INSIGHT

Measuring AGI Progress

  • Measuring progress towards AGI requires diverse tests spanning human cognitive abilities.
  • A comprehensive suite of tests, alongside adversarial attempts to find gaps, helps determine AGI achievement.
INSIGHT

Missing Episodic Memory

  • Current language models lack episodic memory, hindering rapid learning of specific information.
  • Humans utilize episodic memory, bridging working memory and long-term cortical memory.
INSIGHT

Sample Inefficiency Not Fatal

  • LLMs' inefficiency with sample data, needing trillions of tokens, isn't a fatal flaw.
  • New models demonstrate understanding, unlocking scalable solutions for existing shortcomings.
Get the Snipd Podcast app to discover more snips from this episode
Get the app