
Geoffrey Hinton: Unpacking The Forward-Forward Algorithm
Eye On A.I.
Is There a Capsule Encoder?
Activity-based forward-forward algorithm compares top-down and bottom-up predictions in neural networks./nIn the high activity version of the algorithm, the objective is to have the top-down and bottom-up inputs agree./nThe forward forward algorithm uses activities instead of derivatives in neural networks./nThe algorithm eliminates the need for dynamic routing in capsule encoders./nUniversal capsules in the algorithm can represent any type of thing, eliminating the need for dedicated neurons./nThe algorithm is based on the concept of part-whole hierarchies.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.