Machine Learning Street Talk (MLST) #82 - Dr. JOSCHA BACH - Digital Physics, DL and Consciousness [UNPLUGGED]
28 snips
Nov 27, 2022 
Dr. Joscha Bach, a German AI researcher and cognitive scientist, dives into the profound relationship between computation and consciousness. He discusses the limitations of deep learning and the challenges posed by Gödel's incompleteness theorems. The conversation highlights the importance of mental models in behavior and decision-making. Bach also explores the artistic potential of AI, suggesting that human creativity plays a crucial role. Finally, he examines how consciousness relates to predictive coding, urging a broader understanding of agency in both biological and artificial systems.
AI Snips
Chapters
Books
Transcript
Episode notes
Computation Definition
- Computation is a causal structure with decomposable steps.
- All computational models have equivalent power, disregarding resource constraints.
Gödel's Incompleteness
- Gödel's incompleteness theorems reveal that classical mathematics, being stateless, cannot describe reality without contradictions.
- Computational models resolve this by defining truth as the result of a converging procedure.
Geometry in Physics
- Geometry, as used in physics, is a computational approximation for systems with too many parts to count.
- While useful for macroscopic physics, it's problematic for foundational physics due to the assumption of continuity.
