Data Skeptic

AI Fails on Theory of Mind Tasks

Jun 19, 2023

52:21

Creator website

Highlights

AI Chapters

Episode notes

The Historical Relationship between Psychology, AI, and Cognitive Development

02:47

Variations and Errors in the Smarties and Sally Anne Task

01:32

The consensus on animals having theory of mind

00:55

Introduction

2min

The Intersection Between Cognitive Development and AI

3min

The Path to AI and Cognitive Science

2min

The Theory of Mind

4min

The Theory of Mind

3min

Standard Tasks for Verbal Questions

2min

How to Analyze Ethical Experiments

4min

The Consensus on Adults Having Theory of Mind

4min

The Evolution of Theory of Mind

4min

10.

The Problem With the Turing Test

4min

11.

How to Integrate New Information

2min

12.

The Importance of Reproduction in Chat GPT

5min

13.

How to Get the System to Trip Up

2min

14.

The Importance of Proof of Concept in Cognitive Science

4min

15.

The Self-Bax of Failure

3min

16.

The Importance of Theory of Mind

4min

An assistant professor of Psychology at Harvard University, Tomer Ullman, joins us. Tomer discussed the theory of mind and whether machines can indeed pass it. Using variations of the Sally-Anne test and the Smarties tube test, he explained how LLMs could fail the theory of mind test.