Language and Experience, with Isabela Granic
Clerestory (Bryan Kam)
00:00
The Importance of Context in a Language Model
Althusia's obviousness is all the things that we're not explicitly saying, these are our assumptions, but they're so baked in that we don't even have to highlight them as such. And I think what you were saying is that when you then have a corpus that is about the explicit text or whatever it is, it loses all of that implicit and actually the essential part from which you start, right? Yes, exactly. In a certain sense, all text is skewed maybe towards novelty or something like that or towards divergence because it's rare to make explicit things that are just unproblematically implicit, right? Yeah, I get it. So that was one point. The other
Transcript
Play full episode
