FT Tech Tonic cover image

FT Tech Tonic

Superintelligent AI: can chatbots think?

Nov 28, 2023
Prof. Emily Bender and Pablo Arredondo discuss the intelligence of generative AI systems like ChatGPT and their role in legal reasoning. The limitations of chatbots in language understanding and the concept of 'stochastic parrots' are explored. The challenges of AI systems in explaining reasoning and the debate on AGI funding and anthropomorphization are also discussed.
28:36

Podcast summary created with Snipd AI

Quick takeaways

  • Generative AI systems like chat GPT excel at pattern matching but lack true comprehension and understanding.
  • Claims of emergent capabilities and impressive reasoning abilities in AI systems may be misleading and not indicative of true intelligence.

Deep dives

The Limitations of AI and the Clever Hans Effect

Artificial intelligence, particularly generative AI systems like chat GPT, may appear to exhibit human-level cognitive abilities, such as reasoning and problem-solving. However, experts argue that these systems are actually engaged in advanced pattern matching rather than true understanding or intelligence. They can generate plausible text and even pass exams like the bar exam with impressive scores, but their lack of true comprehension is revealed when asked to explain their reasoning. These AI systems, like chat GPT, are essentially large language models that excel at stringing words together in a coherent manner, but they lack the deeper understanding and meaning behind the words. This reliance on superficial patterns and cues from training data, known as the clever Hans effect, can lead to correct answers for the wrong reasons.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode