BI 163 Ellie Pavlick: The Mind of a Language Model
Brain Inspired
00:00
Are There Manifold Stories to Be Told With Language Models?
In your speculative guessing um you think that's we don't need uh neuro symbolic AI you think neuro the neural net approach it will eventually encompass some symbols as well. Are there manifold stories to be told with language models because they don't have like the traditional recurrence that low-dimensional manifolds looking at the dynamics of a network do? You could imagine finding both types of representations all within the neural network and i think that's a quite plausible outcome. There is definitely people working on manifolds in any of the neural networks but yes there's no recurrence in the current language models so i don't know honestly, I had one student who was starting to look at some manifold
Transcript
Play full episode
