114 - Behavioral Testing of NLP Models, with Marco Tulio Ribeiro
NLP Highlights
00:00
What You Did With These Tests?
The paper outlines how to build these tests, but also instantiates it with some particular examples. So we picked examples of mottos and stuff where we thought that people would think these are solved. And so we tested some research models. We tested bert, we tested roberta,. We also tested a few other ones, like x l nadon or elmo. But they didn't make it to the paper because they were strictly worse than bert or roberta. That's it in a nutshell.
Transcript
Play full episode
