StrategyQA and Big Bench
Data Skeptic
00:00
Strategy QA Dataset - How Many Questions Are in There?
We collected almost 3000 questions, so it's not a huge dataset, but it's good enough for benchmarking. So we did a lot of analysis to see that the data is diverse as we wanted. We also have like nice diagrams that show the distribution of the topics. And finally also in terms of reasoning types, this is like the really important property because we wanted a data set that covers a diverse set of reasoning types.
Transcript
Play full episode
