The podcast explores the distressing possibility of AI causing human extinction and the negative consequences it would have on various aspects of life if superhuman AI becomes a reality.
01:02
forum Ask episode
web_stories AI Snips
view_agenda Chapters
auto_awesome Transcript
info_circle Episode notes
insights INSIGHT
Disruption Beyond Extinction
Katja Grace expresses distress over the potential disruption of life with superhuman AI, even without human extinction.
Many valued aspects of human life, like writing and friendships, might be lost or irreversibly changed.
Get the Snipd Podcast app to discover more snips from this episode
I guess there’s maybe a 10-20% chance of AI causing human extinction in the coming decades, but I feel more distressed about it than even that suggests—I think because in the case where it doesn’t cause human extinction, I find it hard to imagine life not going kind of off the rails. So many things I like about the world seem likely to be over or badly disrupted with superhuman AI (writing, explaining things to people, friendships where you can be of any use to one another, taking pride in skills, thinking, learning, figuring out how to achieve things, making things, easy tracking of what is and isn’t conscious), and I don’t trust that the replacements will be actually good, or good for us, or that anything will be reversible.
Even if we don’t die, it still feels like everything is coming to an end.
LessWrong (Curated & Popular)