Is Grounding Required to Understand Language?

The study was based on a psychological study that produced a data set testing, whether or not particular individuals had trouble understanding implicature. And we turned it into binary classification tasks that allowed us without further training to just see whether models can sort of capture this. And we noticed a fairly interesting result. When you start looking at open eyes, da Vinci models, and now we're looking at other sort of models in a similar class, the models that are trained to follow instructions, you notice that they don't necessarily operate at human performance. But they they're performing significantly better than randomly. They're close to human performance, if you look at their, at how well they're correlating

Transcript

Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.