Exploring the Dangers of Superintelligence and Alignment Challenges

I’m doing a new weekly show on the AI Risk Network called Warning Shots. Check it out!

I’m only cross-posting the first episode here on Doom Debates. You can watch future episodes by subscribing to the AI Risk Network channel.

This week's warning shot: Mark Zuckerberg announced that Meta is racing toward recursive self-improvement and superintelligence. His exact words: "Developing superintelligence is now in sight and we just want to make sure that we really strengthen the effort as much as possible to go for it." This should be front-page news. Instead, everyone's talking about some CEO's dumb shenanigans at a Coldplay concert.

Recursive self-improvement is when AI systems start upgrading themselves - potentially the last invention humanity ever makes. Every AI safety expert knows this is a bright red line. And Zuckerberg just said he's sprinting toward it. In a sane world, he'd have to resign for saying this. That's why we made this show - to document these warning shots as they happen, because someone needs to be paying attention

* 00:00 - Opening comments about Zuckerberg and superintelligence

* 00:51 - Show introductions and host backgrounds

* 01:56 - Geoff Lewis psychotic episode and ChatGPT interaction discussion

* 05:04 - Transition to main warning shot about Mark Zuckerberg

* 05:32 - Zuckerberg's recursive self-improvement audio clip

* 08:22 - Second Zuckerberg clip about "going for superintelligence"

* 10:29 - Analysis of "superintelligence in everyone's pocket"

* 13:07 - Discussion of Zuckerberg's true motivations

* 15:13 - Nuclear development analogy and historical context

* 17:39 - What should happen in a sane society (wrap-up)

* 20:01 - Final thoughts and sign-off

Show Notes

Hosts:

* Doom Debates - Liron Shapira's channel

* AI Risk Network - John Sherman's channel

* Lethal Intelligence - Michael's animated AI safety content

This Episode's Warning Shots:

* Mark Zuckerberg podcast appearance discussing superintelligence

* Geoff Lewis (Bedrock VC) Twitter breakdown

---

Doom Debates’ Mission is to raise mainstream awareness of imminent extinction from AGI and build the social infrastructure for high-quality debate.

Support the mission by subscribing to my Substack at DoomDebates.com and to youtube.com/@DoomDebates