Mind & Matter Computational Neuroscience, Machine Learning vs. Biological Learning, Large Language Models | Marius Pachitariu | 235
How brains compute and learn, blending neuroscience with AI insights.
Episode Summary: Dr. Marius Pachitariu discusses how the brain computes information across scales, from single neurons to complex networks, using mice to study visual learning. He explains the differences between supervised and unsupervised learning, the brain’s high-dimensional processing, and how it compares to artificial neural networks like large language models. The conversation also covers experimental techniques, such as calcium imaging, and the role of reward prediction errors in learning.
About the guest: Marius Pachitariu, PhD is a group leader at the Janelia Research Campus, leading a lab focused on neuroscience with a blend of experimental and computational approaches.
Discussion Points:
- The brain operates at multiple scales, with single neurons acting as computational units and networks creating complex, high-dimensional computations.
- Pachitariu’s lab uses advanced tools like calcium imaging to record from tens of thousands of neurons simultaneously in mice.
- Unsupervised learning allows mice to form visual memories of environments without rewards, speeding up task learning later.
- Brain activity during sleep or anesthesia is highly correlated, unlike the high-dimensional, less predictable patterns during wakefulness.
- The brain expands sensory input dimensionality (e.g., from retina to visual cortex) to simplify complex computations, a principle also seen in artificial neural networks.
- Reward prediction errors, driven by dopamine, signal when expectations are violated, aiding learning by updating internal models.
- Large language models rely on self-supervised learning, predicting next words, but lack the forward-modeling reasoning humans excel at.
Related episode:
- M&M 44: Consciousness, Perception, Hallucinations, Selfhood, Neuroscience, Psychedelics & "Being You" | Anil Seth
*Not medical advice.
All episodes, show notes, transcripts, and more at the M&M Substack
Affiliates:
- KetoCitra—Ketone body BHB + potassium, calcium & magnesium, formulated with kidney health in mind. Use code MIND20 for 20% off any subscription (cancel anytime)
- Lumen device to optimize your metabolism for weight loss or athletic performance. Code MIND for 10% off
- Readwise: Organize and share what you read. 60 days FREE through link
- SiPhox Health—Affordable at-home blood testing. Key health markers, visualized & explained. Code TRIKOMES for a 20% discount.
- MASA Chips—delicious tortilla chips made from organic corn & grass-fed beef tallow. No seed oils or artificial ingredients. Code MIND for 20% off
For all the ways you can support my efforts