In this engaging discussion, Dr. Maxwell Ramstead, Director of Research at VERSES and a thought leader on the intersection of math, physics, and philosophy, explores the intriguing free energy principle. He explains how this paradigm shifts our understanding of survival, emphasizing the need for systems to minimize 'surprise' to maintain order. Topics span cognition, the role of philosophy in science, and the ethical implications for AI development. Ramstead also delves into complex concepts like Markov blankets and generative models, uncovering their relevance to understanding existence.
The free energy principle explains systems' persistence by minimizing surprise, ensuring internal states match anticipated ones.
Lifeforms rigorously model and predict their environments to counter entropy, seeking harmony between expectations and reality.
The free energy principle offers insights into survival imperatives, underlying order from cells to societies.
Active inference applied to AI models by Verses AI Technologies aims to create explainable AI based on the free energy principle.
Deep dives
Origins of Maxwell Ramsted's Intellectual Journey
Maxwell Ramsted, a philosopher, mathematician, and leading prognosticator on the free energy principle, exhibited a precocious interest in mathematics and science from an early age.
Significance of Free Energy Principle
The free energy principle, originating from neuroscientist Professor Karl Friston, provides a unified theory covering mathematics, physics, philosophy, complex systems, and cognition.
Implications of Free Energy Principle
The free energy principle explains why living beings constantly strive to model, predict, and understand their surroundings, offering insights into survival imperatives and counterbalancing entropic forces.
Application of Active Inference to Artificial Intelligence
Verses AI Technologies aims to apply active inference to artificial intelligence, creating explainable AI models with generative models and optimal dynamic systems based on the free energy principle.
Overview of Spatial Web Foundation's Development
The Spatial Web Foundation is creating public standards for building shared knowledge graphs, similar to Wiki data, to develop a spatial web ecosystem reflecting human situation structures. This initiative combines active inference-based AI with generative models within a hyperspace representation, ensuring graphical inference and knowledge graph transformation.
Proposed Standards-Based Approach for Responsible AI Development
Amid hype and concerns surrounding AI technologies, an alternative standards-based approach is proposed by the Spatial Web Foundation. This method aims to consolidate global intellectual efforts through open standards, allowing collaborative development while emphasizing ethical, responsible, and transparent practices in the AI domain.
Free Energy Principle and Emergence
The discussion delves into emergence within the context of the free energy principle and consciousness. The principle provides tools for weak emergence issues, while strong emergence, notably consciousness, is considered a candidate. The exploration of consciousness ties into internal Markov blanket concepts and potential future advancements in understanding consciousness through free energy principle applications.
Patreon: https://www.patreon.com/mlst
Discord: https://discord.gg/ESrGqhf5CB
Join us for a fascinating discussion of the free energy principle with Dr. Maxwell Ramsted, a leading thinker exploring the intersection of math, physics, and philosophy and Director of Research at VERSES. The FEP was proposed by renowned neuroscientist Karl Friston, this principle offers a unifying theory explaining how systems maintain order and their identity.
The free energy principle inverts traditional survival logic. Rather than asking what behaviors promote survival, it queries - given things exist, what must they do? The answer: minimizing free energy, or "surprise." Systems persist by constantly ensuring their internal states match anticipated states based on a model of the world. Failure to minimize surprise leads to chaos as systems dissolve into disorder.
Thus, the free energy principle elucidates why lifeforms relentlessly model and predict their surroundings. It is an existential imperative counterbalancing entropy. Essentially, this principle describes the mind's pursuit of harmony between expectations and reality. Its relevance spans from cells to societies, underlying order wherever longevity is found.
Our discussion explores the technical details and philosophical implications of this paradigm-shifting theory. How does it further our understanding of cognition and intelligence? What insights does it offer about the fundamental patterns and properties of existence? Can it precipitate breakthroughs in disciplines like neuroscience and artificial intelligence?
Dr. Ramstead completed his Ph.D. at McGill University in Montreal, Canada in 2019, with frequent research visits to UCL in London, under the supervision of the world’s most cited neuroscientist, Professor Karl Friston (UCL).
YT version: https://youtu.be/8qb28P7ksyE
https://scholar.google.ca/citations?user=ILpGOMkAAAAJ&hl=frhttps://spatialwebfoundation.org/team/maxwell-ramstead/https://www.linkedin.com/in/maxwell-ramstead-43a1991b7/https://twitter.com/mjdramstead
VERSES AI: https://www.verses.ai/
Intro: Tim Scarfe (Ph.D)
Interviewer: Keith Duggar (Ph.D MIT)
TOC:
0:00:00 - Tim Intro
0:08:10 - Intro and philosophy
0:14:26 - Intro to Maxwell
0:18:00 - FEP
0:29:08 - Markov Blankets
0:51:15 - Verses AI / Applications of FEP
1:05:55 - Potential issues with deploying FEP
1:10:50 - Shared knowledge graphs
1:14:29 - XRisk / Ethics
1:24:57 - Strength of Verses
1:28:30 - Misconceptions about FEP, Physics vs philosophy/criticism
1:44:41 - Emergence / consciousness
References:
Principia Mathematica
https://www.abebooks.co.uk/servlet/BookDetailsPL?bi=30567249049
Andy Clark's paper "Whatever Next? Predictive Brains, Situated Agents, and the Future of Cognitive Science" (Behavioral and Brain Sciences, 2013)
https://pubmed.ncbi.nlm.nih.gov/23663408/
"Math Does Not Represent" by Erik Curiel
https://www.youtube.com/watch?v=aA_T20HAzyY
A free energy principle for generic quantum systems (Chris Fields et al)
https://arxiv.org/pdf/2112.15242.pdf
Designing explainable artificial intelligence with active inference
https://arxiv.org/abs/2306.04025
Am I Self-Conscious? (Friston)
https://www.frontiersin.org/articles/10.3389/fpsyg.2018.00579/full
The Meta-Problem of Consciousness
https://philarchive.org/archive/CHATMO-32v1
The Map-Territory Fallacy Fallacy
https://arxiv.org/abs/2208.06924
A Technical Critique of Some Parts of the Free Energy Principle - Martin Biehl et al
https://arxiv.org/abs/2001.06408
WEAK MARKOV BLANKETS IN HIGH-DIMENSIONAL, SPARSELY-COUPLED RANDOM DYNAMICAL SYSTEMS - DALTON A R SAKTHIVADIVEL
https://arxiv.org/pdf/2207.07620.pdf
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode