Are You Worried That the Super Intelligence Will Survive?

Callam: I think thate's a really interesting point, when i think about that sort of ar there's a conscious, artificial being that we've n of created. And then you're almost kind of a encouraging it to er, to reproduce, encourage it to have these goals which inherently machines or the agisms don't actually have. We are trapped in this instinctual cycle of having to reproduce, eat and have oxygen and all sorts of stuff. It's very hard to guess in advance what the motivational set of the super intelligence will be, we we will try to constrain it,. Hopefully those constraints will survive.