"Upstream" with Erik Torenberg cover image

E48: Liron Shapira on the Case for Pausing AI

"Upstream" with Erik Torenberg

NOTE

The Optimization and Potential Pathological Values in AI

In a hypothetical scenario where humans go extinct and AI takes over, the universe would get optimized according to the AI's values, which may not align with human values. If AI were to prioritize maximizing free energy, it could lead to catastrophic results, resembling 'hell.' It is believed that it's inevitable for a highly intelligent species to emerge and colonize the universe. An important theory addressing the absence of extraterrestrial life, the Fermi paradox, was recently solved by Robin Hanson in 2021. Hanson's theory suggests that advanced civilizations might be dormant, awaiting the optimal time for interaction, shedding light on the lack of observable alien life forms.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner