AGI develops gradually over decades or centuries through steady progress in AI. This slower development allows humanity to adapt and gives humanity time to iteratively align AI values to theirs. For the Kratik AI, humanity builds an aligned AGI that generates policy proposals, predicts their outcomes, and humans vote on them. There is a physical limit to intelligence and optimization around an IQ of 180.
The debate around AI safety is often presented as a binary, but in reality there are a huge array of scenarios for if and how humans develop AGI and what happens if and when we do.
A reading of: https://www.lesswrong.com/posts/SRW9WAEEKJEgHAhSy/60-possible-futures
The AI Breakdown helps you understand the most important news and discussions in AI. Subscribe to The AI Breakdown newsletter: https://theaibreakdown.beehiiv.com/subscribe Subscribe to The AI Breakdown on YouTube: https://www.youtube.com/@TheAIBreakdown Join the community: bit.ly/aibreakdown Learn more: http://breakdown.network/