AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Um, Is There a Hybrid?
In the 19 95 book, "Copy Cat," you wrote about how attention can be combined with other types of information to create a kind of hybrid system. What i'm wondering is today, say, more than 20 years later, if you've kind of thought about that again in the contexts of what's happening right now with transformers and attention? So one of the big differences with things like transformers, and i think there ol nuts in general, is the idea of dinamics,. That that perception is this dinamical unfolding, uh, a process that occurs in time, feeback at every tat continual feedback.