AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Is There a Capsule Encoder?
When you talk about the activity, that's similar to what you were doing with then grads where you're comparing top down predictions and bottom up predictions. This when you do the recurrent version of the forward forward algorithm. At each time step, neurons in a layer getting top down input and bottom up input. And they'd like them to agree. If your objective function is to have high activity. They'd like to make things highly active. But let's stick with the version where you're going for high activity. You want the top down and bottom up to agree and give you high activity. Notice that it's not like the top down is a derivative. So in attempts to implement back