The Problem With AI's Goals

There is a theoretical reason to expect other utility maximizes to want to take your resources if they can. So it's sort of a question of the goals that AI systems might end up with, how many end up in conflict. One argument given for this is just that value space is very large. There are just a whole lot of ways you could want the universe to be. If someone has different values from you, probably they're bad.