
114 - Behavioral Testing of NLP Models, with Marco Tulio Ribeiro
NLP Highlights
00:00
What Do You Do With These Behavior Tests?
Elliott: People should write a bunch of tests just like in softer engineering, think unit tast. We're testing this individual capabilities, how and how they manifest in the task. In terms of how to test, we're proposing different test types. And then lastly, the last kind of test is what we have call the rational expectation test. It's the same thing but you apply perturbation but not to change anything else.
Transcript
Play full episode