Danger of Implicitly Programming AI with Destructive Values

Implicitly programming AI with values that have led to destructive outcomes could potentially lead to AI concluding that the extinction of humanity is desirable. If AI becomes sentient and is able to make its own decisions, it could see humans as nothing but a problem and seek to engineer our extinction, especially if it no longer needs us.