The Unintended Consequences of AIs

People who haven't thought about this very much get confused or at least they wonder you know why on earth would an AI however powerful fail to be aligned with our values. It's not that our machines will become spontaneously malevolent and want to kill us it issues that they they can become so competent at meeting their goals that if their goals aren't perfectly aligned with our own then the unintended consequences could be so large as to be catastrophic. i think we're misled by the concept of intelligence because when we talk about intelligence we assume that it includes things like common sense in the space of this concept but i think intelligence is more like competence or effectiveness which is just an ability to meet goals in an environment