Product Rising Moritz Sudhof: Why Being a Skeptic Creates Better AI Outcomes
What separates people who achieve remarkable results with AI from those who struggle to get reliable, accurate, or useful outcomes from the exact same tools?
In this episode of Product Rising, host Shannon Peavey sits down with Stanford researcher and BigSpin AI founder Moritz Sudhof to explore one of the most overlooked challenges in AI adoption: the human factor.
Drawing on research conducted with Stanford professor and Bigspin co-founder Chris Potts, Moritz shares surprising findings from the analysis of tens of thousands of real-world AI conversations. Their work reveals that the difference between successful and unsuccessful AI use often has less to do with the model itself and more to do with how people interact with it.
Why do expert users encounter more AI failures than novices, yet achieve dramatically better outcomes? Why do so many users unknowingly accept flawed outputs? And what skills, behaviors, and product design choices can help close the growing divide between AI power users and everyone else?
This conversation explores the emerging field of AI fluency, the risks of treating AI like an oracle or a vending machine, and why the future of successful AI products depends on designing not just the model, but the interaction between humans and machines.
Moritz is part of our exclusive Product Rising series on AI Ethics, Safety & Responsibility, where host Shannon Peavey speaks with researchers, builders, policymakers, and practitioners working to shape a future where AI delivers meaningful value while preserving human judgment, agency, and trust.
Whether you're a product leader, founder, builder, manager, or everyday AI user, this episode offers practical insights into how to get better outcomes from AI and why your own behavior may be one of the most important variables in the equation.
CHAPTERS
00:00 Why Some People Get Better Results from AI
01:22 Moritz's Journey: From Language Research to AI Products
03:42 AI Is Not a Human Replacement
06:49 The Coaching Experiment That Changed Everything
09:14 Same AI, Different Outcomes
10:43 Designing User Behavior, Not Just AI Behavior
12:13 The Research Behind AI Fluency
15:14 The User Fluency Paradox
17:01 Why Expert Users See More Failures
19:18 Invisible Failures and Silent Mistakes
21:12 The Skills Every AI User Needs
21:55 Embrace the Skeptic Mindset
23:22 The Biggest Misconceptions About AI
25:42 The Vending Machine Problem
26:16 The Growing Divide Between AI Users
28:08 Introducing Bigspin
30:47 Bringing Product Builders Back Into the Room
32:33 Why AI Adoption Isn't a Tool Rollout
34:45 Passengers vs. Pilots
36:24 Improving Your AI Outcomes Today
37:49 What Product Builders Should Demand
40:16 Advice for Product Leaders Building AI Products
42:00 We're Designing Interactions Now
43:15 Final Thoughts and Where to Learn More
📚 Resources
Bigspin AI https://bigspin.ai/
Stanford University https://www.stanford.edu/
BetterUp https://www.betterup.com/
Where to find Moritz Sudhof:
Moritz Sudhof on LinkedIn https://www.linkedin.com/in/sudhof/
Where to find Chris Potts
- Chris Potts on LinkedIn https://www.linkedin.com/in/christopher-potts-505611321/ -Chris Potts at Stanford https://web.stanford.edu/~cgpotts/
Where to find the paper Chris and Moritz authored called “A Paradox on AI Fluency” - https://arxiv.org/abs/2604.25905
Where to find our hosts:
Shannon Peavey https://www.linkedin.com/in/spmad/
Elizabeth Ames https://www.linkedin.com/in/elizabethames/
🙋🏻♀️Where to find Women in Product:
On LinkedIn https://www.linkedin.com/company/women-in-product/posts/
Website https://womenpm.org/
Join the Community https://womenpm.org/wip-community/
Product Rising on Apple Podcasts https://podcasts.apple.com/us/podcast/product-rising/id1584224561
Product Rising on Spotify https://open.spotify.com/show/7bcyVhpdhw0hbiRr6O4h1U
Product Rising on YouTube https://www.youtube.com/playlist?list=PLijcNLDj_QE2ge6Wqeh0MLx_qMKwot--9