
Episode 26: Sugandha Sharma, MIT, on biologically inspired neural architectures, how memories can be implemented, and control theory
Generally Intelligent
00:00
Recency Bias on the Heterosocial System
There's no real recency bias in that current system either, right? No, not yet. But for the recency bias on the heterosocial it would be a simple term that can be added, weight decay for instance, and that can help add the Recency bias. If we are thinking of this model to be like a memory motif that might might occur in different parts of the brain, then it's possible that the underlying structure is the same. You have a knob that you can do depending on how well you want to remember memories and a certain modality. So this should be a knob that can be tunable in the model, right?
Transcript
Play full episode