
Ajeya Cotra on how Artificial Intelligence Could Cause Catastrophe
Future of Life Institute Podcast
The Importance of Human Feedback in Decision-Making
Alex has developed motives that are different from our own. But the researchers at this magma company, they haven't discovered this because they've trained it to be safe. When they then deploy Alex in the real world, how do you imagine that things could go radically wrong? Yeah, so the first thing that happens when Alex is deployed in thereal world is that it makes many copies of itself and does many different tasks. They all think a lot faster than humans. And they're often making decisions on the basis of knowledge or intuitions they developed during their training that humans don't necessarily share. So, it could be the case at some point human understanding deteriorates enough that Alex could be