Explore v.s. Exploit: Finding Solutions Quickly Can Get You Stuck in a Local Optimum

2min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

The explore, exploit trade-off in computer science highlights the challenge of simultaneously optimizing for effectively doing things (exploit) and search through all the possibilities (explore). When trying to find new solutions, one can either search for solutions similar to the ones already known, making small changes to accommodate new evidence quickly, or consider the possibility of a much better solution that is further away in a high dimensional space. While the former allows for quickly finding a pretty good solution, the latter may lead to finding a much better solution, albeit in a space too large to search systematically.

Humans have an unusually long childhood — and an unusually long elderhood past the age of reproductive activity. Why do we spend so much time playing and exploring, caregiving and reflecting, learning and transmitting? What were the evolutionary circumstances that led to our unique life history among the primates? What use is the undisciplined child brain with its tendencies to drift, scatter, and explore in a world that adults understand in such very different terms? And what can we transpose from the study of human cognition as a developmental, stage- wise process to the refinement and application of machine learning technologies?

Welcome to COMPLEXITY, the official podcast of the Santa Fe Institute. I’m your host, Michael Garfield, and every other week we’ll bring you with us for far-ranging conversations with our worldwide network of rigorous researchers developing new frameworks to explain the deepest mysteries of the universe.

This week we talk to SFI External Professor Alison Gopnik, Professor of Psychology and Affiliate Professor of Philosophy at the University of California Berkeley, author of numerous books on psych, cognitive science, childhood development. She writes a column at The Wall Street Journal, alternating with Robert Sapolsky. Slate said that Gopnik is “where to go if you want to get into the head of a baby.” In our conversation we discuss the tension between exploration and exploitation, the curious evolutionary origins of human cognition, the value of old age, and she provides a sober counterpoint about life in the age of large language machine learning models.

Be sure to check out our extensive show notes with links to all our references at complexity.simplecast.com. If you value our research and communication efforts, please subscribe, rate and review us at Apple Podcasts or Spotify, and consider making a donation — or finding other ways to engage with us at santafe.edu/engage.

Lastly, we have a bevy of summer programs coming up! Join us June 19-23 for Collective Intelligence: Foundations + Radical Ideas, a first-ever event open to both academics and professionals, with sessions on adaptive matter, animal groups, brains, AI, teams, and more. Space is limited! Apps close February 1st.

OR Apply to participate in the Complex Systems Summer School.

OR the Graduate Workshop on Complexity in Social Science.

OR the Complexity GAINS UK program for PhD students.

Thank you for listening!

Join our Facebook discussion group to meet like minds and talk about each episode.

Podcast theme music by Mitch Mignano.

Mentioned & Related Links:

Alison Gopnik at Wikipedia

Alison Gopnik’s Google Scholar page

Explanation as Orgasm
by Alison Gopnik

Twitter thread for Gopnik’s latest SFI Seminar on machine learning and child development

Changes in cognitive flexibility and hypothesis search across human life history from childhood to adolescence to adulthood
by Gopnik et al.

Pretense, Counterfactuals, and Bayesian Causal Models: Why What Is Not Real Really Matters
by Deena Weisberg & Alison Gopnik

Childhood as a solution to explore–exploit tensions
by Alison Gopnik

The Origins of Common Sense in Humans and Machines
by Kevin A Smith, Eliza Kosoy, Alison Gopnik, Deepak Pathak, Alan Fern, Joshua B Tenenbaum, & Tomer Ullman

What Does “Mind-Wandering” Mean to the Folk? An Empirical Investigation
by Zachary C. Irving, Aaron Glasser, Alison Gopnik, Verity Pinter, Chandra Sripada

Models of Human Scientific Discovery
by Robert Goldstone, Alison Gopnik, Paul Thagard, Tomer Ullman

Love Lets Us Learn: Psychological Science Makes the Case for Policies That Help Children
by Alison Gopnik at APS

Our Favorite New Things Are the Old Ones
by Alison Gopnik at The Wall Street Journal

An exchange of letters on the role of noise in collective intelligence
by Daniel Kahneman, David Krakauer, Olivier Sibony, Cass Sunstein, & David Wolpert#DEVOBIAS2018 on SFI Twitter

Coarse-graining as a downward causation mechanism
by Jessica Flack

Complexity 90: Caleb Scharf on The Ascent of Information: Life in The Human Dataome

Complexity 15: R. Maria del-Rio Chanona on Modeling Labor Markets & Tech Unemployment

Learning through the grapevine and the impact of the breadth and depth of social networks
by Matthew Jackson, Suraj Malladi, & David McAdams

The coming battle for the COVID-19 narrative
by Wendy Carlin & Sam Bowles

Complexity 83: Eric Beinhocker & Diane Coyle on Rethinking Economics for A Sustainable & Prosperous World

Complexity 97: Glen Weyl & Cris Moore on Plurality, Governance, and Decentralized Society