Classical hand-crafted models vs modern RNNs

Support the show to get full episodes, full archive, and join the Discord community.

The Transmitter is an online publication that aims to deliver useful information, insights and tools to build bridges across neuroscience and advance research. Visit thetransmitter.org to explore the latest neuroscience news and perspectives, written by journalists and scientists.

Read more about our partnership.

Sign up for Brain Inspired email alerts to be notified every time a new Brain Inspired episode is released.

To explore more neuroscience news and perspectives, visit thetransmitter.org.

Tatiana Engel runs the Engel lab at Princeton University in the Princeton Neuroscience Institute. She's also part of the International Brain Laboratory, a massive across-lab, across-world, collaboration which you'll hear more about. My main impetus for inviting Tatiana was to talk about two projects she's been working on. One of those is connecting the functional dynamics of cognition with the connectivity of the underlying neural networks on which those dynamics unfold. We know the brain is high-dimensional - it has lots of interacting connections, we know the activity of those networks can often be described by lower-dimensional entities called manifolds, and Tatiana and her lab work to connect those two processes with something they call latent circuits. So you'll hear about that, you'll also hear about how the timescales of neurons across the brain are different but the same, why this is cool and surprising, and we discuss many topics around those main topics. 

• Engel Lab.
• @engeltatiana.bsky.social.
• International Brain Laboratory.
• Related papers:
  • Latent circuit inference from heterogeneous neural responses during cognitive tasks
  • The dynamics and geometry of choice in the premotor cortex.
  • A unifying perspective on neural manifolds and circuits for cognition
  • Brain-wide organization of intrinsic timescales at single-neuron resolution
  • Single-unit activations confer inductive biases for emergent circuit solutions to cognitive tasks.

0:00 - Intro 3:03 - No central executive 5:01 - International brain lab 15:57 - Tatiana's background 24:49 - Dynamical systems 17:48 - Manifolds 33:10 - Latent task circuits 47:01 - Mixed selectivity 1:00:21 - Internal and external dynamics 1:03:47 - Modern vs classical modeling 1:14:30 - Intrinsic timescales 1:26:05 - Single trial dynamics 1:29:59 - Future of manifolds