Ajeya Cotra on how Artificial Intelligence Could Cause Catastrophe
Future of Life Institute Podcast
00:00
How to Train a Model to Predict the World
The idea with this training method is that you have a model that's initially trained to predict the world, like GPT-3 is trained to predict text. And then on top of that foundation of prediction, you have the model try a large variety of different tasks and then give it feedback based on how well it performs. The hope is that in new tasks that aren't seen in training, it's sort of even if it hasn't seen anything extremely similar to that, it'll apply its general problem solving abilities that it's developed.
Transcript
Play full episode
