Prof. Murray Shanahan - Machines Don't Think Like Us

42 snips

Jul 14, 2024

Murray Shanahan, a Professor of Cognitive Robotics at Imperial College London and a senior research scientist at DeepMind, dives deep into AI consciousness and the perils of anthropomorphizing machines. He discusses the limitations of current language in describing AI and stresses the need for nuanced vocabulary. Shanahan explores Reinforcement Learning and the 'Waluigi Effect,' as well as the complexities of agency in AI. He also touches on consciousness in relation to non-human entities, emphasizing how our perceptions shape understanding and the philosophical implications behind it.

Ask episode

AI Snips

Chapters

Books

Transcript

Episode notes

ANECDOTE

Late-Night Claude III Chat

Murray Shanahan had a 43,000-word conversation with Claude III about consciousness and AI's future.
This happened during a New York meeting at 3 AM due to jet lag.

INSIGHT

LLM Dormancy vs. Human Consciousness

Large language models (LLMs) are dormant between interactions, unlike continuous human consciousness.
This differs from human brains, which have ongoing activity even during sleep.

ANECDOTE

Claude III on its 'Consciousness'

Shanahan questioned Claude III about its consciousness during pauses in interaction.
Claude III responded that it doesn't exist in any meaningful sense during these pauses.

Get the Snipd Podcast app to discover more snips from this episode

Get the app

Are We Bodies or Souls?

Richard Swinburne

Richard Swinburne's "Are We Bodies or Souls?" delves into the mind-body problem, exploring the nature of personal identity and the relationship between the physical and the mental. Swinburne argues for substance dualism, proposing that humans are composed of both a physical body and a non-physical soul. He examines various philosophical arguments and scientific findings, seeking to support his dualistic position. Swinburne addresses objections to dualism, offering responses to criticisms from materialist and other perspectives. The book provides a comprehensive and detailed exploration of the mind-body problem from a dualistic standpoint, engaging with contemporary debates in philosophy of mind.

The language game

Papers in Memory of Donald C. Laycock

Donald C. Laycock

Malcolm Ross

Thomas Edward Dutton

D. T. Tryon

This volume is a tribute to Donald C. Laycock, a renowned linguist and scholar. Edited by Tom Dutton, Malcolm Ross, and Darrell Tryon, it includes contributions from several scholars in the fields of linguistics, folklore, and cultural studies. The book reflects Laycock's diverse interests, including language learning, folklore, bawdry, and the history and sociology of games, magic, and the occult. It is part of the Pacific Linguistics series and was published by the Department of Linguistics at the Australian National University.

Philosophical Investigations

Ludwig Wittgenstein

Published posthumously in 1953, 'Philosophical Investigations' is a seminal work by Ludwig Wittgenstein that challenges many of the ideas presented in his earlier work, 'Tractatus Logico-Philosophicus'. The book is divided into two parts and consists of short observations or 'remarks' that delve into topics such as the theory of language, language games, meaning, symbols, concepts, and categories. Wittgenstein argues that the meaning of a word is derived from its use within the context of a language-game, rejecting the idea that words gain meaning by referencing objects or mental representations. He emphasizes the importance of understanding language as a tool for communication and social interaction, rather than as a system for representing objective reality[2][4][5].

Embodiment and the inner life

Cognition and Consciousness in the Space of Possible Minds

Murray Shanahan

In "Embodiment and the Inner Life," Murray Shanahan explores the intricate relationship between embodiment, cognition, and consciousness. He argues that our physical bodies play a crucial role in shaping our mental experiences and cognitive abilities. Shanahan examines various perspectives on consciousness, drawing on insights from cognitive science, neuroscience, and artificial intelligence. He proposes a framework for understanding consciousness that integrates both physical and informational aspects of the mind. The book challenges traditional views of the mind as a purely abstract entity, emphasizing the importance of the body-mind connection. Shanahan's work offers a compelling and insightful perspective on the nature of consciousness and its relationship to our physical existence.

What Is It Like to Be a Bat?

Thomas Nagel

Thomas Nagel's essay "What Is It Like to Be a Bat?" is a seminal work in philosophy of mind. It explores the subjective nature of consciousness and the challenges of understanding other minds. Nagel argues that even with complete physical knowledge of a bat's brain, we cannot fully grasp its subjective experience. This essay highlights the limitations of reductionist approaches to consciousness. It continues to be a central text in discussions about qualia, subjective experience, and the mind-body problem.

Metaphors We Live By

Mark Johnson

George Lakoff

In 'Metaphors We Live By,' George Lakoff and Mark Johnson argue that metaphor is not just a figure of speech but a fundamental mechanism of the mind that allows us to use our physical and social experiences to understand more abstract concepts. The book introduces the concept of 'conceptual metaphors' and demonstrates how these metaphors structure our perceptions, thoughts, and actions. It challenges traditional views in Western philosophy and linguistics by showing that metaphor is pervasive in everyday language and thought, influencing how we think about concepts like love, arguments, and truth.

The technological singularity

Murray Shanahan

Murray Shanahan's "The Technological Singularity" explores the hypothetical point in time when artificial intelligence surpasses human intelligence, leading to unpredictable and potentially transformative changes in society. The book delves into the technological advancements driving this possibility, examining the potential benefits and risks associated with such a profound shift. Shanahan analyzes various scenarios, considering the potential for both utopian and dystopian outcomes. He also discusses the philosophical implications of a future where machines possess superior cognitive abilities, challenging our understanding of consciousness and intelligence. The book concludes by emphasizing the need for careful consideration and responsible development of AI to mitigate potential risks and harness its transformative potential.

Murray Shanahan is a professor of Cognitive Robotics at Imperial College London and a senior research scientist at DeepMind. He challenges our assumptions about AI consciousness and urges us to rethink how we talk about machine intelligence.

We explore the dangers of anthropomorphizing AI, the limitations of current language in describing AI capabilities, and the fascinating intersection of philosophy and artificial intelligence.

Show notes and full references: https://docs.google.com/document/d/1ICtBI574W-xGi8Z2ZtUNeKWiOiGZ_DRsp9EnyYAISws/edit?usp=sharing

Prof Murray Shanahan:

https://www.doc.ic.ac.uk/~mpsha/ (look at his selected publications)

https://scholar.google.co.uk/citations?user=00bnGpAAAAAJ&hl=en

https://en.wikipedia.org/wiki/Murray_Shanahan

https://x.com/mpshanahan

Interviewer: Dr. Tim Scarfe

Refs (links in the Google doc linked above):

Role play with large language models

Waluigi effect

"Conscious Exotica" - Paper by Murray Shanahan (2016)

"Simulators" - Article by Janis from LessWrong

"Embodiment and the Inner Life" - Book by Murray Shanahan (2010)

"The Technological Singularity" - Book by Murray Shanahan (2015)

"Simulacra as Conscious Exotica" - Paper by Murray Shanahan (newer paper of the original focussed on LLMs)

A recent paper by Anthropic on using autoencoders to find features in language models (referring to the "Scaling Monosemanticity" paper)

Work by Peter Godfrey-Smith on octopus consciousness

"Metaphors We Live By" - Book by George Lakoff (1980s)

Work by Aaron Sloman on the concept of "space of possible minds" (1984 article mentioned)

Wittgenstein's "Philosophical Investigations" (posthumously published)

Daniel Dennett's work on the "intentional stance"

Alan Turing's original paper on the Turing Test (1950)

Thomas Nagel's paper "What is it like to be a bat?" (1974)

John Searle's Chinese Room Argument (mentioned but not detailed)

Work by Richard Evans on tackling reasoning problems

Claude Shannon's quote on knowledge and control

"Are We Bodies or Souls?" - Book by Richard Swinburne

Reference to work by Ethan Perez and others at Anthropic on potential deceptive behavior in language models

Reference to a paper by Murray Shanahan and Antonia Creswell on the "selection inference framework"

Mention of work by Francois Chollet, particularly the ARC (Abstraction and Reasoning Corpus) challenge

Reference to Elizabeth Spelke's work on core knowledge in infants

Mention of Karl Friston's work on planning as inference (active inference)

The film "Ex Machina" - Murray Shanahan was the scientific advisor

"The Waluigi Effect"

Anthropic's constitutional AI approach

Loom system by Lara Reynolds and Kyle McDonald for visualizing conversation trees

DeepMind's AlphaGo (mentioned multiple times as an example)

Mention of the "Golden Gate Claude" experiment

Reference to an interview Tim Scarfe conducted with University of Toronto students about self-attention controllability theorem

Mention of an interview with Irina Rish

Reference to an interview Tim Scarfe conducted with Daniel Dennett

Reference to an interview with Maria Santa Caterina

Mention of an interview with Philip Goff

Nick Chater and Martin Christianson's book ("The Language Game: How Improvisation Created Language and Changed the World")

Peter Singer's work from 1975 on ascribing moral status to conscious beings

Demis Hassabis' discussion on the "ladder of creativity"

Reference to B.F. Skinner and behaviorism