The Gradient: Perspectives on AI cover image

Raphaël Millière: The Vector Grounding Problem and Self-Consciousness

The Gradient: Perspectives on AI

00:00

The Distributional Hypothesis of Language Models

I'd love to dig a little bit further into your thoughts on this question specifically, and how that relates to the task of language model. I think that where a lot of this begins is we have the famous distributional hypothesis which says words are defined by the company they keep. And so there's this aspect of like my grip on the world that in a particular moment, I can intuit that something maybe qualifies as a chair in that particular situation. But even when it comes to concepts, there's this contextuality to them.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app