114 - Behavioral Testing of NLP Models, with Marco Tulio Ribeiro
NLP Highlights
00:00
Can We Do Machine Completion on Single Sentence?
The way that we collect dit is set is such that we do not have them. O, if you're collecting a machine comprehension test, it would make sense to start very simple and say, can we do machine comprehension on single sentences? And then can we move two paragraphs, and then ho articles or something? But the way we do it right now is we say, ok, let me define tha procedure. I'm going to take wecipedia paragraphs, then let me define the way i'm going to get the questions, and ten, ok, turkers are going to get them. So we end up with the sdata sets that have a particular distribution that typically
Transcript
Play full episode
