Dario Amodei, CEO of Anthropic, has written a new essay on his thoughts on AI risk of various shapes. It seems worth reading, even if just for understanding what Anthropic is likely to do in the future.
Confronting and Overcoming the Risks of Powerful AI There is a scene in the movie version of Carl Sagan's book Contact where the main character, an astronomer who has detected the first radio signal from an alien civilization, is being considered for the role of humanity's representative to meet the aliens. The international panel interviewing her asks, “If you could ask [the aliens] just one question, what would it be?” Her reply is: “I’d ask them, ‘How did you do it? How did you evolve, how did you survive this technological adolescence without destroying yourself?” When I think about where humanity is now with AI—about what we’re on the cusp of—my mind keeps going back to that scene, because the question is so apt for our current situation, and I wish we had the aliens’ answer to guide us. I believe we are entering a rite of passage, both turbulent and inevitable, which will test who we are as a species. Humanity [...]
---
Outline:(00:24) Confronting and Overcoming the Risks of Powerful AI
(15:19) 1. I'm sorry, Dave
(15:23) Autonomy risks
(28:53) Defenses
(41:17) 2. A surprising and terrible empowerment
(41:22) Misuse for destruction
(54:50) Defenses
(01:00:25) 3. The odious apparatus
(01:00:30) Misuse for seizing power
(01:13:08) Defenses
(01:19:48) 4. Player piano
(01:19:51) Economic disruption
(01:21:18) Labor market disruption
(01:33:43) Defenses
(01:37:43) Economic concentration of power
(01:40:49) Defenses
(01:43:13) 5. Black seas of infinity
(01:43:17) Indirect effects
(01:47:29) Humanity's test
(01:53:58) Footnotes
The original text contained 92 footnotes which were omitted from this narration. ---
First published: January 26th, 2026
Source: https://www.lesswrong.com/posts/kzPQohJakutbtFPcf/dario-amodei-the-adolescence-of-technology ---
Narrated by
TYPE III AUDIO.
