Exploring PDoom and AI Risks

In this special cross-post from Jona Ragogna’s channel, I'm interviewed about why superintelligent AI poses an imminent extinction threat, and how AI takeover is going to unfold.

Newly exposed to AI x-risk, Jona asks sharp questions about why we’re racing toward superintelligence despite the danger, and what ordinary people can do now to lower p(doom). This is one of the most crisp explainers of the AI-doom argument I’ve done to date.

Timestamps

0:00 Intro

0:41 Why AI is likely to cause human extinction

2:55 How AI takeover happens

4:55 AI systems have goals

6:33 Liron explains p(Doom)

8:50 The worst case scenario is AI sweeps us away

12:46 The best case scenario is hard to define

14:24 How to avoid doom

15:09 Frontier AI companies are just doing "ad hoc" alignment

20:30 Why "warning shots" from AI aren't scary yet

23:19 Should young adults work on AI alignment research?

24:46 We need a grassroots movement

28:31 Life choices when AI doom is imminent

32:35 Are AI forecasters just biased?

34:12 The Doom Train™ and addressing counterarguments

40:28 Anthropic's new AI welfare announcement isn't a major breakthrough

44:35 It's unknown what's going on inside LLMs and AI systems

53:22 Effective Altruism's ties to AI risk

56:58 Will AI be a "worthy descendant"?

1:01:08 How to calculate P(Doom)

1:02:49 Join the unofficial If Anyone Builds It, Everyone Dies book launch party!

Show Notes

Subscribe to Jona Ragogna — https://youtube.com/@jonaragogna

IF ANYONE BUILDS IT LAUNCH WEEK EVENTS:

Mon Sep 15 @ 9am PT / 12pm ET / 1600 UTCMy Eliezer Yudkowsky premieres on YouTube! Stay tuned for details.

Tue Sep 16 @ 2pm PT / 5pm ET / 2100 UTCThe Doom Debates unofficial IABI Launch Party!!!

More details about launch week HERE!

---

Doom Debates’s Mission is to raise mainstream awareness of imminent extinction from AGI and build the social infrastructure for high-quality debate.

Support the mission by subscribing to my Substack at DoomDebates.com and to youtube.com/@DoomDebates