The Jim Rutt Show cover image

EP40 Eric Smith on the Physics of Living Systems

The Jim Rutt Show

00:00

The Problem of Language Change in Deep Learning

Language only functions because its components are a system. There's no magic in the fact that i begin the word language with a le sound. In many respects, the sort of the joint change of the system with the tokens that carry the properties of the system. And that's rich because context discovery remains a hard problem. I would love to see the deep learning community,. which has been so data centric, start to take more of an interest in grammar Discovery and things like that. Because i think we will learn more about the nature of grammar when we start to ask deep learning systems to unpack what they know about language.

Play episode from 01:07:12
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app