

Great Strategy Starts with Experimentation
131 snips Apr 16, 2025
Stefan Thomke, a Harvard Business School professor and author of "Experimentation Works," delves into the transformative power of experimentation in business. He discusses how successful companies like Netflix and Booking.com leverage A/B testing for competitive advantage. Thomke highlights the pitfalls of relying on intuition, advocating for a data-driven decision-making approach. He shares insights on cultivating an experimental culture within organizations, encouraging all employees to engage in small-scale experiments to drive innovation and growth.
AI Snips
Chapters
Books
Transcript
Episode notes
Bing's $100M Experiment
- An employee at Microsoft's Bing insisted on running an ad display experiment despite skepticism.
- The experiment generated over $100 million in additional revenue in its first year, proving the power of testing.
Risk Misconceptions of Experiments
- Business leaders often overestimate the risks and underestimate the rewards of running experiments.
- Proper stoppage rules and acknowledging uncertainty help mitigate perceived risks of experimentation.
Kohl's Opening Hour Experiment
- Kohl's ran experiments to test if opening an hour later would save money without hurting revenue.
- The results showed neutral impact on revenue, illustrating the value of testing big decisions.