

Joe Carlsmith on How We Change Our Minds About AI Risk
17 snips Jun 22, 2023
Chapters
Transcript
Episode notes
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49
Introduction
00:00 • 3min
The Failure Mode of Human Beliefs in AI Risk
03:22 • 2min
The Pattern of Predictability in AI Risk
05:12 • 2min
The Importance of Trusting Yourself
07:28 • 3min
The Importance of Capacity in AI Progress
10:35 • 2min
The Danger of the Alignment Discourse
12:13 • 3min
How to Update Your AI Progress in the Correct Way
15:39 • 4min
The Unimaginable Future of AI
19:31 • 3min
How I Reacted to the Idea of AI Risk
22:07 • 3min
The Visceral Relationship Between AI Risk and Bio2
25:32 • 4min
AI Risk: The Right Story
29:07 • 3min
The Unreality of the Future
32:30 • 2min
The Future Feels Unreal to Us
34:27 • 5min
The Importance of Priors in AI Risk
39:39 • 5min
AI Risk: A Tough Game
44:53 • 4min
The Importance of Agents Pursuing Goals
49:11 • 2min
The Dangers of Misalignment
50:44 • 2min
The Dangers of Alienating Ourselves From Our Gut Feelings
53:14 • 3min
How to Manage Your Gut's Relationship to AI
55:49 • 2min
The Future of AI Risk
57:24 • 3min
The Importance of Modeling AI Risk
01:00:13 • 3min
The Benefits of Creating Your Own Models of AI Risk
01:03:24 • 4min
The Rise of AI as an Existential Risk
01:07:50 • 4min
The Risk From Extinction Is 15%
01:12:05 • 2min
The Importance of Language Models in AI
01:14:14 • 4min
AI and the Future of Humanity
01:18:18 • 2min
The Importance of Scalable Oversight
01:20:16 • 3min
The Risks of AI Extinction
01:23:34 • 3min
The Evolution of Digital Sentience
01:26:28 • 2min
The Consciousness of Computers
01:28:16 • 2min
AI and the Limits of Consciousness
01:30:00 • 3min
The Plausibility of Digital Sentience
01:33:08 • 3min
The Limits of Digital Sentience
01:36:33 • 3min
The Doomers and the Epistemology of AI Risk
01:39:56 • 3min
The Retroactive Assessment of AI Risks
01:42:26 • 3min
Benchmarks for AI Progress
01:45:24 • 3min
The Economic Impact of AI on the Real World Economy
01:48:03 • 3min
The Scariest Scenarios for AI R&D
01:51:05 • 2min
The Future of AI Research and Development
01:53:31 • 3min
The Future of AI Research and Development
01:56:32 • 2min
The Barrier to AI Automating AI Research and Development
01:58:03 • 3min
The Importance of Focusing on Specific Projects in the Next Decade
02:01:09 • 3min
The Uncertainty of AGI
02:03:48 • 3min
The Future of AI Safety
02:06:24 • 3min
The Importance of Scalable Alignment Techniques
02:09:18 • 2min
The Dark Side of Interpretability Research
02:11:44 • 5min
The Pessimistic Take on AI Interpreters
02:16:53 • 3min
Philosophy Matters in a World With Short Timelines
02:19:39 • 3min
The Future of Philosophy
02:22:37 • 2min