The Language Neuroscience Podcast Deep learning algorithms, natural language processing, and the brain, with Jean-Rémi King
8 snips
Jul 10, 2023 Jean-Rémi King, research scientist and team leader at Meta AI, discusses deep learning algorithms, natural language processing, and the brain. They explore the similarities between brain responses and deep net activations, factors for algorithm similarity to the brain, and the need for nonlinear composition in language processing. They also delve into the size of predicted chunks, the functional similarity between deep neural networks and brain voxels, and the importance of choosing the right model architecture and parameters for predicting brain activity.
AI Snips
Chapters
Transcript
Episode notes
Linux Preference
- Jean-Rémi King, though now using a Mac, prefers Linux.
- He even installed Linux on colleague Anna Kasdan's computer.
AI to Neuroscience
- King's interest in AI started with Lego Mindstorms and early internships.
- He transitioned to computational neuroscience due to AI's limitations at the time, eventually landing at Meta AI.
Meta AI's Philosophy
- Meta AI's research philosophy mirrors academia, prioritizing peer review and open-source contributions.
- This approach allows researchers to explore general principles, even without immediate product applications.