Steven Sloman: LLMs and Deliberative Reasoning

If you’ve used a large language model, you’ve likely had one or more moments of amazement as the tool immediately responded with impressive content from its massive data cosmos training set. But you’ve likely also had moments of confusion or disillusionment as the tool responded with irrelevant or incorrect responses, displaying a lack of reasoning.

A recent research paper from Meta caught our eye because it proposes a new mechanism called System 2 Attention which “leverages the ability of LLMs to reason in natural language and follow instructions in order to decide what to attend to.” The name System 2 is derived from the work of Daniel Kahneman who in his 2011 book, Thinking, Fast and Slow, differentiated between System 1 thinking as intuitive and near-instantaneous and System 2 thinking as slower and effortful. The Meta paper also references our friend Steven Sloman who in 1996 made the case for two systems of reasoning—associative and deliberative or rule-based.

Given our interest in the idea of LLMs being able to help people make better decisions—which often requires more deliberative thinking—we asked Steve to come back on the podcast to get his reaction to this research and generative AI in general. Yet again, we had a dynamic conversation about human cognition and modern AI, which field is learning what from the other, and a few speculations about the future. We’re grateful for Steve taking the time to talk with us again and hope that he’ll join us for a third time when his next book is released sometime in 2024.

Steven Sloman is a professor of cognitive, linguistic, and psychological sciences at Brown University where he has taught since 1992. He studies how people think, including how we think as a community, a topic he wrote a fantastic book about with Philip Fernbach called The Knowledge Illusion: Why We Never Think Alone. For more about that work, please check out our first interview with Steve from June of 2021.

About Artficiality from Helen & Dave Edwards:

Artificiality is a research and services business founded in 2019 to help people make sense of artificial intelligence and complex change. Our weekly publication provides thought-provoking ideas, science reviews, and market research and our monthly research releases provides leaders with actionable intelligence and insights for applying AI in their organizations. We provide research-based and expert-led AI strategy and complex change management services to organizations around the world.

We are artificial philosophers and meta-researchers who aim to make the philosophical more practical and the practical more philosophical. We believe that understanding AI requires synthesizing research across disciplines: behavioral economics, cognitive science, complexity science, computer science, decision science, design, neuroscience, philosophy, and psychology. We are dedicated to unraveling the profound impact of AI on our society, communities, workplaces, and personal lives. 

Subscribe for free at https://www.artificiality.world.

If you enjoy our podcasts, please subscribe and leave a positive rating or comment. Sharing your positive feedback helps us reach more people and connect them with the world’s great minds.

Learn more about ⁠⁠Sonder Studio⁠⁠

Subscribe to get ⁠⁠Artificiality⁠⁠ delivered to your email

Learn about our book ⁠⁠Make Better Decisions⁠⁠ and buy it on ⁠⁠Amazon⁠⁠

Thanks to ⁠⁠Jonathan Coulton⁠⁠ for our music

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.artificiality.world.

#ai #artificialintelligence #generativeai #airesearch #complexity #futureofai