Eye On A.I. cover image

Geoffrey Hinton: Unpacking The Forward-Forward Algorithm

Eye On A.I.

NOTE

Is There a Capsule Encoder?

Activity-based forward-forward algorithm compares top-down and bottom-up predictions in neural networks./nIn the high activity version of the algorithm, the objective is to have the top-down and bottom-up inputs agree./nThe forward forward algorithm uses activities instead of derivatives in neural networks./nThe algorithm eliminates the need for dynamic routing in capsule encoders./nUniversal capsules in the algorithm can represent any type of thing, eliminating the need for dedicated neurons./nThe algorithm is based on the concept of part-whole hierarchies.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner