Episode 26: Sugandha Sharma, MIT, on biologically inspired neural architectures, how memories can be implemented, and control theory

1

Introduction

00:00 • 4min

2

Theoretical Neuroscience: Reusable Components

03:34 • 3min

3

How to Reuse Components Across Tasks

06:22 • 3min

4

Learning Weights for Decoders

09:24 • 2min

5

Deep Learning

11:07 • 4min

6

The Upper Limits in Information Theory That Stop Applying, Right?

14:49 • 2min

7

ICML Paper - Mesh or Batch?

16:27 • 4min

8

Is Hetero-Associative Tagging a Machine Learning Tool?

20:30 • 2min

9

The Learning Mechanism of the Attributor Manifold

22:47 • 2min

10

Student-Verse Learning - Continuous Degradation

25:16 • 2min

11

Is There Anything That's Missing From the Model?

27:41 • 2min

12

Recency Bias on the Heterosocial System

30:01 • 2min

13

Is There a Future in Cognitive Science?

31:46 • 3min

14

How to Represent Non-Parametric Distributions in Neural Circuits

34:17 • 2min

15

Using SBD, You Can Represent Non-Parametric Distributions

36:34 • 2min

16

How to Use Bayesian Inference to Study the Brain

38:17 • 3min

17

The Hippocampal System

40:48 • 3min

18

The Hippocampus Meatballs Is Kind of Exponential, Right?

43:25 • 2min

19

The Coding Mechanism of the Student Medicine?

45:02 • 4min

20

Is There a Pattern in Nature?

49:04 • 2min

21

Using Grid Cells to Encode High Dimensional Variables

50:40 • 3min

22

Is There a Reuse of the Structure in Memory Palaces?

53:47 • 2min

23

The Memory Palace

56:12 • 2min

24

How Do You Store Non-Spatial Elements?

58:09 • 3min

25

How Do You Characterize the Network Strengths and Recommendations?

01:01:21 • 2min

26

Are We Using Inductive Biases in Deep Learning?

01:03:13 • 2min

27

How to Scale Large Scale Networks

01:05:18 • 2min

28

Using Control Theory to Build Neural Networks

01:06:57 • 3min

29

Using Control Theory to Train RNNs

01:09:33 • 2min

30

What's the Biggest Impact of Josh Derenbaum?

01:11:11 • 2min

31

Is There a Need to Sync Theory and Experiment in Neuroscience?

01:13:17 • 3min

32

The SLAM Problem and the Atlas Framework, Right?

01:16:34 • 2min

33

Is There a Difference Between Left Hand and Right Hand Drive?

01:19:04 • 2min

34

Scaling Your Models Across Environments

01:21:03 • 3min

35

Is Scalability a Blocker to Scalability?

01:23:53 • 3min

36

How to Reuse Across Environments?

01:26:55 • 2min

37

Do You Have Any Additional Questions?

01:28:31 • 3min

38

Do You Have Unusual or Controversial Opinions in the Field of Neuroscience?

01:31:10 • 2min

39

Neuroscience - What's Blocking Progress?

01:32:53 • 2min

40

Is There a Big Map of the Brain?

01:35:21 • 2min

41

Is There a Difference Between Collaboration and Collaboration?

01:36:56 • 2min

42

Is Initiating Collaborations Healthy?

01:38:51 • 2min

43

Are There Any Concerns About AI?

01:40:31 • 4min