AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Is the Paper Clip Maximizer Too Special?
i don't even know that we need to resolve this for insten i think the is ogt distinction is ultimately specio. But i can still grant that it is logically possible, and i would certainly imagine physically possible, to have a system that has a utility function that is suff only strange that scaling up its intelligence doesn't get you values that we would recognize as good. Whether a paper clipp maximizer is too special or not is an open question. There's certainly something that we could fail to put into a superhuman ai that we really would want to put in so as to make it alined with us.