Open Domain Question Answering Data

We looked at a variety of data sets that encapsulate what you can think of as open domain question answering. There are other conditions in which in healthcare you might want to do closed domain question answering for example. And so we felt it was really important to involve people both clinicians but also lay people with lived experience of diseases in evaluating different aspects of these models. We thought that's actually a pretty good way of starting to curate a data set that's representative of questions that are commonly that matter that matter to billions of consumers around the world. The second part of the paper is not so much about the tasks but maybe about how do you begin to evaluate these things thoughtfully, and again there