LessWrong (Curated & Popular) cover image

"AGI Ruin: A List of Lethalities" by Eliezer Yudkowsky

LessWrong (Curated & Popular)

00:00

The Real Lethalness Comes From the First Critical Try

Human beings can figure out pretty difficult things overtime when they get lots of tries. When a failed gues kills literally everyone. This is where practically all of the real lethality comes from, that we have to get things right on the first sufficiently critical try. If we had unlimited re tries, if every time an a g i destroyed all the galaxies, we would be able to go back in time four years and try again. Two years after the leading actor has the capability to destroy the world, five other actors will have the capability to do it too.

Play episode from 11:59
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app