
Episode 26: Sugandha Sharma, MIT, on biologically inspired neural architectures, how memories can be implemented, and control theory
Generally Intelligent
00:00
ICML Paper - Mesh or Batch?
I was actually working on the, on building a model of the inter-renal hippocampal system in the brain. And I just stumbled upon this architecture where I got this nice memory feature,. which showed this degraded performance as you were storing more and more memories in the system. So it wasn't really me trying to build a memory system. It was really me tryingto build the hippocampusal attractor network in the brain and the feature just fell out of it. Yeah. The mesh ideas very, very simple in the sense that conceptually, it's just separating the input features from memory. You can do that in various ways, right? And we've presented one way of playing that
Transcript
Play full episode