I, scientist with Balazs Kegl

Why are LLMs so alien?Is it because they lack goal-oriented behavior?Or because they are designed to please humans, which can be unsettling?Join me and Laura in this new episode where we discuss her paper "Active inference goes to school", AI and 4E cognitive science, active inference and child development, and AI in the classroom.My notes on Laura's paper: https://balazskegl.substack.com/p/active-inference-goes-to-school00:00:00 Intro00:05:44 4E cognitive science. Embodied, enacted, embedded, extended. Mirror neurons and meaning. Scaffolding. 00:20:03 LLMs and extendedness. Confabulations. 00:29:53 LLM vs social media AI. The role of embodiment and the scariness of disembodied LLM. Loopholes.00:37:20 Active inference. LLMs are trained like kids in a classical school. Building artifacts to align reality with internal model. Pragmatic vs objective truth.00:56:45 Child development and active inference. Cognitive and physical are intertwined. The role of history and culture.01:07:02 Montessori. Flow and the speed of learning. Prepared environment.01:13:46 AI in school and work.01:19:40 Laura's journey. Marx, cinema, history of science, biology, running a bar, having a child, second PhD.01:22:43 The role of artifacts in forming the mind. Memorabilia.01:29:37 Having a child. Starting school during Covid. The role of imitation in learning and its lack in school. Aspiration. Copying. Learning and sense.01:40:47 Embodied AI, when can I read it? Laura's question to me. Martial arts. Meditation. I, scientist blog: https://balazskegl.substack.comTwitter: https://twitter.com/balazskeglArtwork: DALL-EMusic: Bea Palya https://www.youtube.com/channel/UCBDp3qcFZdU1yoWIRpMSaZw Hosted on Acast. See acast.com/privacy for more information.

What, if anything, differentiates us from machines? Is cognition computational? Can self-preservation be externally imposed? How do you feel in your body when you hear the word "singularity"?Join us in a thought-provoking conversation with Anna Riedl, a distinguished cognitive scientist from Vienna, known for her work on rationality.We dive deep into psychology, cognitive science, and artificial intelligence. What I find exemplary about Anna is how she plants her feet firmly in the real world while embarking deep, wide-ranging, and sometimes controversial topics in one of the fastest moving fields in science.Anna recently co-authored an insightful paper on "Naturalizing Relevance Realization," shedding light on how our understanding of relevance in cognitive processes can be grounded in naturalistic terms. For a deeper dive into the themes of our conversation, including my summary and notes on this groundbreaking paper, visit https://balazskegl.substack.com/p/naturalizing-relevance-realization.00:00:00 Intro.00:05:51 Rationality and intelligence. Small and large worlds, the frame problem.00:12:58 Non-computational (but physical!) framing, relevance realization, natural agency, cognition. Naturalistic teleology.00:20:07 Algorithm vs organism through reinforcement learning lens.00:33:18 Relevance realization. Bayesian rationality and the paradox of timescale. Social media AI.00:47:40 Self-preservation: intrinsic or external goal?00:51:23 Opponent processing. 00:57:08 Circularity argument for the non-learnability of relevance realization.01:00:27 Ecology of agents. Where does the agential world start?01:04:47 Singularity and self-manufacturing. Parasitic processing. Rationality. How do we construe the world? How does a topic make you feel?01:11:16 What's next for Anna? Naturalizing decision-making.01:14:15 Insight.01:16:49 Prophecy, anticipation, forecasting, threshold points and agency, faith.01:20:13 How and why Anna became a cognitive scientist? Creativity, clear thinking, psychology, cognitive science.01:25:02 Black-box vs constructive predictive models. Implicit vs explicit. 01:29:33 Collective expertise, higher-level organisms.01:36:52 What got me into tech? Anna's question to me.I, scientist blog: https://balazskegl.substack.comTwitter: https://twitter.com/balazskeglArtwork: DALL-EMusic: Bea Palya https://www.youtube.com/channel/UCBDp3qcFZdU1yoWIRpMSaZw Hosted on Acast. See acast.com/privacy for more information.

Jakob Nordin is an observational astrophysicist from the Humboldt University, Berlin, member of the LSST collaboration building the Vera Rubin Observatory and the informational infrastructure to manage the immense data it will collect.Real-time astronomy & LSST: We discuss the intriguing potential of real-time astronomy, focusing on the Large Synoptic Survey Telescope (LSST), its technology and data processing challenges.Multi-messenger astrophysics & brain-like structure: Explored the fascinating concept of multi-messenger astrophysics, where various observatories act like sensors in a brain-like structure, collaboratively detecting cosmic events. Discussed how this network uses a semi-automatic system of alerts to direct scientific attention efficiently, highlighting the organic and evolving nature of this expansive, interconnected system.AI in astronomy: Explored how artificial intelligence is integrated into astronomical research, particularly in image analysis and classification within massive data streams like those expected from LSST.00:00:00 Intro. LSST.00:03:43 Universe as a lab. Astronomer, astrophysicist, observational astrophysicist.00:09:15 The space of astronomical observatories: what messenger, what energy, what field of view (patch of sky), what timescale?00:11:15 Vera Rubin Observatory and LSST collaboration: optical wavelengths, large field of view, detailed map and daily transients. Several instruments in one.00:13:17 Space or ground? Trade-offs and complementarity.00:16:16 Technology: Mirror and camera.00:19:20 Atmosphere. How to deal with turbulence? Exotic locations.00:22:01 Numbers. 7 trillion detections, 37 billion objects (transients).00:23:16 Categories of transients: noise, Solar system objects (planets, asteroids), Milky way (variable stars), extragalactic (giant black holes, supernovae)00:27:57 Alert rate: 10 million nightly events. 60 sec latency.00:30:54 Multi-messenger astrophysics. 00:39:27 Sociological paradigm change.00:43:45 Unknown unknowns. The similarities between multi-messenger astrophysics and a living multi-sensorial perceptual system.00:47:44 AI, what works what does not.00:52:38 Data brokers. Scarcity of resources forces a distributed TAME-like organization in science.00:59:02 AI. Noise filtering. Transient categorization.01:03:3 0 Training data: mostly simulations. Data augmentation.01:07:50 The sociological paradigm change: using telescope time to verify AI pipelines. 01:09:57 Instrumental meditation: AI models need to be calibrated.01:11:08 The price of knowledge. How to calibrate exploration?01:14:06 Why astrophysics? Curiosity + coincidence.01:18:16 What does a scientist do?01:21:05 Organization. Small groups evolving towards large-scale experiments.01:24:56 AI, software, data science, computer science, computer engineering. 01:29:20 Productionalizing AI. Big data vs. small data. AI is tough when models are exposed to reality.01:34:40 GPT for writing and coding. Hallucination and novelty.01:40:18 "Do I get the money?" Would I finance real-time astronomy? How to choose what to work on?01:43:02 Debates are overrated. Jakob's question: Can a podcast change what we do? Can a guest change how I live? You can change me if I want to become like you.01:51:05 Epistemic authority. How do we make decisions? How can we trust information?I, scientist blog: https://balazskegl.substack.comTwitter: https://twitter.com/balazskeglArtwork: DALL-EMusic: Bea Palya https://www.youtube.com/channel/UCBDp3qcFZdU1yoWIRpMSaZw Hosted on Acast. See acast.com/privacy for more information.

The second hour is really just two guys trying to make sense of what's going on in the world as a reaction to AI and the meaning crisis, explored through the works of John Vervaeke. I'm sure the insights from this conversation will resonate with many educators and technologists alike. If you like it, please help the channel by signing up!00:00:00 Intro00:06:53 Path to teaching writing.00:15:36 Why do we write? Making an impact vs having a voice vs thinking something through.00:20:37 GPT vs human writing. The voice of GPT. Simile and metaphors.00:34:05 Teaching and AI. Assisting a lesson plan.00:37:48 Assessment in the age of GPT: policing or integration?00:46:51 OER: teaching LLMs within Open Education Resources.00:53:11 AI assistance: feedback generated by LLMs. Should we learn to drive a stick or read maps?01:03:32 GPT as a dialogical partner.01:10:14 Vervaeke's AI video essay. https://balazskegl.substack.com/p/notes-on-john-vervaekes-ai-the-coming01:15:02 Opponent processing: dialog, jujitsu.01:22:37 Jeremy England, life, entropy, dissipation, and e/acc.01:26:20 Doom vs zoom: I don't agree with the framing.01:34:49 Relevance realization and Vervaeke's trinity: nomological, normative, and narrative order.01:41:35 Open theology vs closed worlds.01:48:05 The irony of Enlightenment.01:52:11 What should educators be aware of around AI? Joel's question to me.I, scientist blog: https://balazskegl.substack.comTwitter: https://twitter.com/balazskeglArtwork: DALL-EMusic: Bea Palya https://www.youtube.com/channel/UCBDp3qcFZdU1yoWIRpMSaZw Hosted on Acast. See acast.com/privacy for more information.

00:00:00 Intro.00:03:18 Stories. Why do they fascinate us? Mechanism of emotional manipulation.00:06:45 True to life vs realistic. Startrek. Dramatic real stories are rarely good.00:10:08 GPT and stories. How to build stories word-by-word. What is creativity? Information and meaning. Saturation in the story space. Alignment of living and writing.00:19:25 Yellowstone. What makes a story good? Lioness. Average is OK but don't expect to get payed for it. 00:23:24 GPT and storywriting. Write us a joke about migrants. A new episode of Sherlock.00:28:54 Art = fire + algebra. A good story makes you want to stop watching it and reengage with your life.00:31:53 Fire in children and mystics. Chickens: individuals vs a category. Surprise and predictability. Intelligence is overrated.00:39:46 Christianity. The tension and harmony between the transcendent and the particular. The role of lived experience in storywriting.00:45:47 The zombie myth. Metaverse. Transhumanism. What is AI after? Zuckerberg and jujitsu.00:57:44 AGI singularity vs narrow social media AI. Cautious humbleness and exploration. Personalized storytelling and an autistic world. Disembodiment.01:15:50 GPT: how to use it for writing better stories? Support the research process then go and face real life. Paradoxically it will slow down the writing process.01:22:16 Love: learning by loving vs just downloading knowledge.I, scientist blog: https://balazskegl.substack.comTwitter: https://twitter.com/balazskeglArtwork: DALL-EMusic: Bea Palya https://www.youtube.com/channel/UCBDp3qcFZdU1yoWIRpMSaZw Hosted on Acast. See acast.com/privacy for more information.

Delving into the complexities of consciousness, the podcast explores qualia, physicalism, dualism, and illusionism. It challenges the idea of a private world being an illusion and discusses self-awareness, emotions, and representational systems. The conversation delves into the subjective nature of experiences, the concept of high-functioning zombies in AI, and the intersection of consciousness and personal experiences.

00:00:00 Intro: empirical vs armchair philosopher. Visual vs tactile understanding.00:06:08 How subjective experience rises from physical matter. Entering wine into your body vs seeing a tomato. Perception of color, pain, interoception.00:14:09 Consciousness is not a thing, but conscious is an adjective.00:18:24 Brain is (part of) the body. The developmental biology view.00:21:23 Immune system: what is you, what is not you?00:24:30 Cells, tissue, (https://www.youtube.com/shorts/Rvmvt7gscIM) organs, body, how does hierarchical agency function? The relational ontology.00:27:08 Love, hate, and self, me and not me, at every level.00:28:24 Pregnancy. How selves are created and negotiating.00:30:45 Homeostasis and autopoiesis. Allostasis and homeorhesis. We are systems that create themselves. How we learn to deal with gravity? Self disorders.00:38:51 How to do science about first person experience? Reported lived experiences, physiological measurements, brain imaging.00:44:36 Depersonalization. No self-organizing system without movement. Transparent background and its crack. Can't afford processing the self in the background. Sense of touch or odor can bring you back. Fetuses touch themselves and each other.00:55:14 4P of John Vervaeke, is depersonalization a disorder of relevance realization? Automatic vs automaton.01:01:09 Meditation vs depersonalization, phenomena of the same system? Psychosis and depersonalization.01:07:29 Movement and depersonalization.01:09:55 Autism and depersonalization. Why is Anna interested in depersonalization?01:13:23 Feeling like a zombie or a ghost.01:16:22 Dissociation and depersonalization.01:19:01 The detachment of scientists of their subjects. Anna's question to me: what drove me to create the podcast? Soul hunting through interacting with people. We can't do it alone. Movement medicine and contact dance. I, scientist blog: https://balazskegl.substack.comTwitter: https://twitter.com/balazskeglArtwork: DALL-EMusic: Bea Palya https://www.youtube.com/channel/UCBDp3qcFZdU1yoWIRpMSaZw Hosted on Acast. See acast.com/privacy for more information.

00:00:00 Intro: Mark's journey from undergrad physics to psychology, philosophy, and theology.00:05:17 Philosophy: "Who you are is directly related to what you know".00:06:25 The psychology of being a scientist. Lived dualism.00:07:49 Becoming a scientist is to become a certain kind of person, and this very much shapes the scientific worldview.00:08:46 AI is leaked from the lab and becoming a focal point around which the world is turning.00:12:05 Psychology and theology. How are they related? Developmental psychology. Thresholds, crisis moments, self-transcendence. 00:17:23 Intelligence is a deeply felt notion. Crisis, suffering, struggle, not knowing who we will become, are part of our intelligence. Intelligence is a deeply felt notion. It is not isolated, part of the cosmos, which is why science can be done.00:20:11 Self-transformation is optional as an adult. Dante and Barfield: are individual and collective transformations similar?00:32:28 Dante and AI. In hell there is no novelty: closed data set, no imagination, frozen world. Paradise: the joy of knowing more. Music.00:36:00 Fear.00:37:15 Addiction. AI recommendation engines. The infinite scroll.00:41:25 Francis Bacon: "technology was given to humanity by God to bring us back to the garden of Eden, to relieve suffering". Infinite as more and more vs the one thing opening onto all things.00:43:53 The therapeutic use of addictive AI. https://balazskegl.substack.com/p/mental-jujitsu-between-me-and-the My story with social media addiction and martial arts and its theological interpretation.00:49:48 Turing test. First of Mark's ten points. https://www.youtube.com/watch?v=LHIvKFY2kbk The dialogical Turing test. https://balazskegl.substack.com/p/gpt-4-in-conversation-with-itself GPT-4 is a much more sophisticated hell.00:55:53 AI leaders are incentivized to oversell AI. Governments do have levers. "We need more science."00:58:57 AI and feelings. What is to be human?01:01:20 Model of cognition is not cognizant itself.01:04:21 Metaphors of mind. Engineers realize metaphors.01:07:12 Engineering organisms vs machines. Michael Levin.01:09:40 We dwell in presence, not just compute. We participate in reality, not just observe it. The field metaphor. Memory is not stored in the brain.01:16:30 Technology is unadaptive. It is not built into reality, but our reality is built in a way into which technology fits. Thinking machine is an ancient dream.01:19:13 Attention is a moral act. How to manage fear. The GPT panic.01:23:35 Love of life is part of intelligence. Intellect is driven towards what is loved. The silence around the words.01:26:40 Embrace the boredom. Dwell in uncertainty. Convert suffering to hope. Think about our own psychology. The purgatorial state.01:29:27 Mark's question to me: do I feel that this crisis moment can be a turn for the better, rather than this panic-driven fear of what's going to happen. Agency in AI. Cybernetics.01:34:40 Alignment. John Vervaeke's program of bringing up AI.01:38:59 The exponential take-off is a theology. Agency gets more dependent as it gets more sophisticated.01:41:31 The high-functioning zombie metaphor. The fear of zombie AI is what will create it.I, scientist blog: https://balazskegl.substack.comTwitter: https://twitter.com/balazskeglArtwork: DALL-EMusic: Bea Palya https://www.youtube.com/channel/UCBDp3qcFZdU1yoWIRpMSaZw Hosted on Acast. See acast.com/privacy for more information.

00:00:00 Intro. Gaels's journey from physics to AI through coding, then health and social science applications.00:06:17 Looking for impact. Are we using our energy to solve the best problems? How to estimate future impact?00:12:18 How did the interacting with a wide variety of sciences changes you as an AI researcher? Out-of-the box. Empirical research.00:13:19 Benchmarks. How they incorporate value and drive AI research. AI went from a mathematical to an empirical science. Fei-Fei Li and ImageNet.00:19:07 The Autism Challenge: predict the condition from brain imaging. How to avoid fooling ourselves?00:25:24 How did the medical community react? The clash between what is true and what is valuable.00:27:15 How do you measure your scientific impact?00:31:09 Scientific/technological and societal progress.00:33:01 Recommender AI and the 2007 Netflix challenge.00:35:14 How to deal with social media addiction.00:42:06 Scikit-learn. The Toyota of AI. Origin story.A well-designed tool for scientist is also useful for business. 00:47:03 Open source organizational structure. Ecosystem building.00:55:57 Deep learning and scikit-learn.00:59:37 Sociology ad psychology of scikit-learn.01:09:57 How to bring science home. AI has become an ice breaker.01:13:13 Gael's question: what excites me these days. Being seen; clarifying my thoughts through dialogs and writing; agency, RL, and putting AI in hardware we connect with; moving my body.I, scientist blog: https://balazskegl.substack.comTwitter: https://twitter.com/balazskeglArtwork: DALL-EMusic: Bea Palya https://www.youtube.com/channel/UCBDp3qcFZdU1yoWIRpMSaZw Hosted on Acast. See acast.com/privacy for more information.

00:00:00 Intro00:04:20 The LHCb experiment. Fundamental particle physics. Why isn't there as much antimatter as matter? Timescales.00:17:18 Shortcomings of the Standard Model. Dark matter. The LHC.00:22:24 The LHCb collaboration. Organization of a scientific experiment beyond the Dunbar number. Carrier development in academia and physics.00:27:03 The skills and day job of an LHC physicist. The messy organization of a big experiment. Technical vs physics work.00:32:33 The (lack of) management levers and incentives. 70+ institutes. Where does meaning come from?00:38:26 Vava's journey from war-torn Yugoslavia through Vienna and Oxford to CERN in Geneva and permanent position in Paris.00:41:23 Why physics? Curiosity and introversion. The helpers on a hero's journey.00:45:03 The real-time aspects: how we take the data. 30 million+ proton-proton collisions, a few to 30+ Terabits per second. The real-time trigger reduces the rate by 3-4 orders of magnitude.00:48:39 Working in a small group. Career without planning in the early days vs students today.00:51:48 Early adoption of AI and GPUs in the real-time trigger. Separate signal (interesting events) from background (known particles) in a million-dimensional space. Reconstruction cuts it down to 10-20 features where we apply Boosted Decision Trees. Training data and simulation. Neural nets? Sometimes, in complex feature spaces, for example in the calorimeter.01:01:16 Simulation to real data: systematic uncertainties. How to prioritize what to care about? The soft process and social structure of scrutinizing results. The effect of the aggregated knowledge of the collaboration.01:09:29 The delicacies of the scientific method: the look-elsewhere effect and unknown unknowns. The soft side of the Popperian ideal.01:16:46 Who decides what to go after in physics? LHCb: 20 years x 100 PhD thesis is a lot of investment. The role of the critical mass.01:20:27 The International Linear Collider and the sociology of the next big experiment.01:24:10 ATLAS = Cathedral. The deep metaphor: multi-generational experiments. The sacrifice of early-career scientists.01:29:56 Vava's dream for the rest of his career. Survival guilt.01:36:01 Science at home. 01:39:43 Why the podcast? - Vava's question to me. Spirituality and science. Anger and separation anxiety. This little corner of the internet. Truth and importance: the daily dilemma at the Paris-Saclay Center for Data Science.I, scientist blog: https://balazskegl.substack.comTwitter: https://twitter.com/balazskeglArtwork: DALL-EMusic: Bea Palya https://www.youtube.com/channel/UCBDp3qcFZdU1yoWIRpMSaZw Hosted on Acast. See acast.com/privacy for more information.