The Alignment Problem - You Can't Bring the Coffee if You're Dead

Stuart russell: You don't get our common sense unless you programm it into the machine. If we gave a sufficiently intelligent system the goal to kur alsheimers, there are many things that are incompatible with it fulfilling that goal. We have to have a machine that will let us turn it off, even though its primary goal is to cure alseimers. I do think that a lot of people listening may want us to back up and talk about the question of whether you can have something that feels to them like it's so smart and so stupid at the same time. Like, is that a realizable way an intelligence can be? Yes.