Humanity never builds an AGI because they get destructed by a meteor or supervolcano. Nuclear war, alien invasion or economic collapse make it unfeasible for researchers to create AGI. In almost all multiverse timelines, all humans go extinct by AGI. It is theoretically possible to build an AGI but it turns out to take so much resources and energy that it is practically impossible. For some reason or another, souls, consciousness, quantum something, it turn out to be theoretically impossible to build AGI.
The debate around AI safety is often presented as a binary, but in reality there are a huge array of scenarios for if and how humans develop AGI and what happens if and when we do.
A reading of: https://www.lesswrong.com/posts/SRW9WAEEKJEgHAhSy/60-possible-futures
The AI Breakdown helps you understand the most important news and discussions in AI. Subscribe to The AI Breakdown newsletter: https://theaibreakdown.beehiiv.com/subscribe Subscribe to The AI Breakdown on YouTube: https://www.youtube.com/@TheAIBreakdown Join the community: bit.ly/aibreakdown Learn more: http://breakdown.network/