The Sentience Institute Podcast cover image

Raphaël Millière on large language models

The Sentience Institute Podcast

00:00

The Challenge of Compositionality in Language Models

Compositionality is a notion that comes from linguistics. The meaning of a whole of a complex expression, like a sentence, is determined by the meaning of its constituent parts. So if you say, John loves Mary, doesn't mean the same thing as Mary loves John, even though you're using the very same words. This is idea that compositionality is a challenge for language models. And generally for AI systems that are based on artificial neural networks.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app