114 - Behavioral Testing of NLP Models, with Marco Tulio Ribeiro
NLP Highlights
00:00
Is the Sentiment Getting Incoted?
There's some very clear like, bert hates turkey, for example. If you put turkey in, sentiment always goes down. And i think it likes brazil, s ican g if you have a corpus of news articles and you see, like, what's going to be more positive or more negative? Is it going to be afghanistan or hawaii? So you can imagine that models up on the stuff. But interestingly, it also has something with names,. so certain names, you could imagine hitler being negative, but john, mary luke, those have a particularly slant. It may be just randomness, but it is the case that this is happening
Transcript
Play full episode
