114 - Behavioral Testing of NLP Models, with Marco Tulio Ribeiro
NLP Highlights
00:00
Do You Have a Directional Change?
This is the directional change, not the invariance test. My question is like, what? How far can you push this? At some level, you're going to try to make perturbations where if i could actually know what what the corresponding output should be, i'd have already solved the task. Some softer engineering casting ther sentiment nose is moto to come up with in an afternoon,. That kind of perturbation. And trying to exhaustively list everything that the motel should do. Again, we're talking about testing here. We're just talking about hate thes basic tests we should beable to do this.
Transcript
Play full episode
