The Importance of Human Data in Diplomacy

In order to do well in games that involve cooperation, you have to have human data if the game is sufficiently complicated. So we found this giant data set from a website called webdeplomacy.net where they've recorded all the games that people have played on the site for the past 20 years. We trained a model on that data to imitate how humans play and then we combine that with self play. And so we end up with an AI bot that can communicate at a very like human like style about things in talking diplomacy.