Babbage from The Economist (subscriber edition)

AGI, part two: how to make artificial intelligence more like the human kind

Sep 11, 2024
In this enlightening discussion, Abby Bertics, a tech researcher at the Geometric Intelligence Lab with a knack for science writing, explores the quest for artificial general intelligence. The conversation unveils the limitations of current large language models and proposes innovative approaches to integrate reasoning and knowledge. Bertics highlights the need for AI to truly grasp concepts, not just pattern-match. The ethical implications of creating superintelligent machines are examined, raising questions about the balance between potential benefits and inherent risks in this advancing field.
Ask episode
AI Snips
Chapters
Transcript
Episode notes
INSIGHT

LLMs as Gadgets, Not Intelligences

  • LLMs are a gadget that extracts patterns from text on the World Wide Web, not facts or knowledge.
  • They excel at recombining statistical patterns but lack true understanding of the real world.
INSIGHT

How LLMs Understand Language

  • LLMs use tokens, numerical representations of text chunks, to understand language.
  • These tokens are embedded in a "meaning space" where words with similar meanings cluster together.
ANECDOTE

ChatGPT's Map of Europe

  • When asked to draw a map of Europe, ChatGPT mislabeled countries and placed Moscow in four incorrect locations.
  • This demonstrates the LLM's lack of true geographic understanding.
Get the Snipd Podcast app to discover more snips from this episode
Get the app