The Importance of Interpretability in the Evolution of Agency

We don't know what these systems are capable of, and everyone everywhere is just stomping on the gas as quickly as they can. We have no principal reason for ruling out agency evolving in them. And we wouldn't necessarily know what it would look like if we were three tenths of the way there. I very much hope that that field receives a huge boost because we just don't have what we need to inspect the way these systems are evolving.