Andres Glusman, experimentation expert and former Meetup product leader, unpacks why 89% of experiments fail - and why that’s a good thing. From redesign pitfalls to balancing data with intuition, he shares hard-earned lessons on turning failure into explosive growth.
It’s not about running more tests, but smarter ones.
Timestamps & Segments
00:01:02 – 00:10:00
The Experimentation Conundrum
Andres breaks down why most experiments fail, the "VC mindset" for testing, and why a 65% loss rate is better than industry standards.
00:10:05 – 00:20:00
Low Traffic, Big Swings
Strategies for companies with limited traffic: why timid tweaks waste time and how to bundle changes for measurable impact.
00:20:05 – 00:30:00
Redesigns: When to Rip the Band-Aid
Why most redesigns backfire, how to test without tanking metrics, and the political minefield of shipping "VP-approved" flops.
00:30:05 – 00:40:00
Storing (and Ignoring) Experiment Data
The lifecycle of experiment insights, why social proof is overrated, and how to avoid repeating past mistakes (hint: spreadsheets).
00:40:05 – 00:49:00
Hot Takes & Must-Reads
Andres’ controversial read on stale A/B testing dogma + book recs to overhaul your product playbook.
Hot Takes
🔥 “89% failure rate? You’re doing it right.” – Andres
🔥 “If stats aren’t significant after 4 months, ship it anyway—your samples are probably garbage.” – Leah
Send us a text
Leah on Linkedin / Twitter / Youtube
