StrategyQA and Big Bench

1

Introduction

00:00 • 2min

2

Annotator Bias in Natural Language Understanding Data Sets

01:52 • 3min

3

Are the Instructions Really Confusional?

04:41 • 3min

4

Getting the Right Annotator for Crowdsourcing

07:25 • 2min

5

Strategy QA - What We Did to Inspire Creativity

09:19 • 2min

6

Is Aristotle Alive When the Laptop Was Invented?

11:36 • 3min

7

Is the Language of the Question Exposed or Implicit?

14:14 • 2min

8

Strategy QA Dataset - How Many Questions Are in There?

15:51 • 4min

9

How to Decouple Reasoning Processes in Strategy QA?

19:30 • 3min

10

AI2 Leaderboard

22:30 • 4min

11

Strategy QA Is All Yes or No Questions, Right?

26:00 • 2min

12

The Importance of Benchmarks in Natural Language Processing

27:42 • 3min

13

Big Bend Benchmark - What Are the Challenges for Language Models?

30:51 • 2min

14

The Bleeding Edge Benchmark

33:08 • 3min

15

Is There a Future for Artificial General Intelligence?

35:46 • 2min

16

Is Big Bench Really Going to Be the Driving Force in NLP?

37:44 • 4min