AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Are We Concerned About Existential Catastrophes?
Third of the four arguments that power-seeking AI could pose an existential threat to humanity? This empowerment by AI systems would be an existential catastrophe. It seems extremely unlikely that we'd be able to regain power over a system that successfully disempowers humanity. The entirety of the future, everything that happens for Earth-originating life for the rest of time, would be determined by goals not aligned with us. Perhaps those goals will create a long and flourishing future, but we see little reason for confidence.