The Scale Hypothesis in the Bitter Lesson

Vivek: I was so excited when I saw your paper because I thought it was the first legit shot at an algorithm that could do well on step one. We're going to come back to the scale hypothesis in the bitter lesson at the end. But just for the listeners, the summary of the result that I'd like to talk about is you gave it a publicly available set of step one style questions that are used to prep medical students to take the exam. These are multiple choice questions. They're designed to test kind of a broad knowledge base for medical students. And what the test taker has to do is select the right answer from a list of potential answers sort of weighing them