117 - Interpreting NLP Model Predictions, with Sameer Singh
NLP Highlights
00:00
How to Evaluate Explanation Methods
How do you know if these explanation methods are actually any good? That's a really good question. And we don't and honestly the reason I like to read explanation papers now is mostly to focus on how did they do the evaluation? How did they, what new thing did they come up with to show that these explanations might be useful or might not be? There is no standard metric for explanation. For me, I think the most useful metric is does anybody find it useful? Anything that involves user studies or recreation of a user study that shows why these explanations are useful, is a good evaluation technique. It can be used to evaluate attribution and other techniques as well where you ask humans to give
Transcript
Play full episode
