The Adaptive Resonance of Categories in Deep Learning

Dr. Stephen Grossberg is a cognitive scientist, theoretical psychologist, neuroscientists and mathematician who, with Gail Carpenter, is the originator of Adaptive Resonance Theory - an explanation of how we learn without catastrophic forgetting. It also happens to be a solution to the hard problem of consciousness. We discuss the problem of catastrophic forgetting, the ways that resonant states lead to consciousness, the AI cliques that have taken over the industry, and why AGI is impossible under current design parameters. Check out his book, Conscious Mind, Resonant Brain: https://amzn.to/3PshWnc00:00:00 Go! 00:00:17 Who is Steve Grossberg? 00:12:19 Patreon Ask 00:14:44 Learning without Catastrophic forgetting 00:22:26 Bottom Up vs Top Down Systems 00:26:07 Integrating Adaptive Resonance Into Existing Systems 00:30:01 The AI Clique 00:40:03 Gated Steepest Descent: A model for learning 00:54:21 Plagiarism and Progress 01:06:25 Pitfalls of Finite Markovian Chain Models 01:12:44 The Rockefeller University Years 01:26:30 BREAK 01:26:45 Cracking the Hard Problem 01:34:18 Why we have to be conscious 01:41:01 How representations become sufficient 01:51:31 Not All Resonances are Conscious 01:55:24 The Relief System 02:01:47 Steelmanning the hard problem 02:10:18 Integrating flawed ideas 02:13:12 The Solution to the Hard Problem of Consciousness 02:17:29 On the Nature of Qualia 02:21:33 Information is a Vacuous Term 02:25:27 Evolution from Primitive to Complex 02:30:31 Putting ART in Evolutionary Terms 02:33:33 Learning Language Meanings 02:35:25 ChatGPT is a lookup table 02:39:39 Closing Thoughts Support the scientific revolution by joining our Patreon: https://bit.ly/3lcAasB Support Dr. Grossberg by buying his book, Conscious Mind, Resonant Brain: https://amzn.to/3PshWnc Tell us what you think in the comments or on our Discord: https://discord.gg/MJzKT8CQub#consciousness #mind #resonance Check our short-films channel, @DemystifySci: https://www.youtube.com/c/DemystifyingScience AND our material science investigations of atomics, @MaterialAtomics https://www.youtube.com/@MaterialAtomics Join our mailing list https://bit.ly/3v3kz2S PODCAST INFO: Anastasia completed her PhD studying bioelectricity at Columbia University. When not talking to brilliant people or making movies, she spends her time painting, reading, and guiding backcountry excursions. Shilo also did his PhD at Columbia studying the elastic properties of molecular water. When he's not in the film studio, he's exploring sound in music. They are both freelance professors at various universities. - Blog: http://DemystifySci.com/blog - RSS: https://anchor.fm/s/2be66934/podcast/rss - Donate: https://bit.ly/3wkPqaD - Swag: https://bit.ly/2PXdC2y SOCIAL: - Discord: https://discord.gg/MJzKT8CQub - Facebook: https://www.facebook.com/groups/DemystifySci - Instagram: https://www.instagram.com/DemystifySci/ - Twitter: https://twitter.com/DemystifySci MUSIC: -Shilo Delay: https://g.co/kgs/oty671