Edu: Product Experiments - Revealing The Science Behind Successful Apps

Nov 8, 2023

Discover the secret to successful app evolution through thoughtful experimentation, with insights from Meetup founder Andres Glusman. Learn the importance of testing specific hypotheses, establishing causation, and exploring tools like Optimizely and Adobe Target. Explore the downstream and upstream effects of experiments and how DoWhatWorks is revolutionizing the industry by turbocharging the learning curve. Decode the art of product experiments and uncover the science behind app success.

Ask episode

Chapters

Transcript

Episode notes

Introduction

00:00 • 2min

Experimentation and Split Testing in Product Development

01:35 • 11min

The Power of Running Experiments

12:33 • 19min

Understanding Statistical Significance and Error Tolerance in Product Experiments

31:12 • 3min

Applying Bayesian Probability to Running Experiments and Managing Risk

34:31 • 2min

Causation vs. Correlation in Data Analysis

36:06 • 13min

Wrap-up, Guest Information, and Sponsor Ad

49:08 • 2min

Brace yourself for a masterclass in app evolution as Andres Glusman, founder of DoWhatWorks shares 15 years of wisdom gained at Meetup, where experimentation was the key to their monumental growth.

Discover the hidden truth that most experiments fail, but when they succeed, the impact is colossal.

The secret? Thoughtful experimentation. It's about testing specific hypotheses, not just throwing everything at the wall and hoping something sticks.

Experiments go beyond correlation, establishing causation – the only way to truly gauge if your product changes are working. 📊

Statistical significance is crucial, but startups can dance on the edge of uncertainty to move faster and break new ground.

And remember, every experiment carries downstream and upstream effects. Improvements in one metric might ripple through others, for better or worse.

Interested in revolutionising your experiments? Andres suggests exploring tools like Optimizely and Adobe Target. He also explores how DoWhatWorks is changing the industry by allowing companies to learn from each other's experiments, turbocharging the learning curve and skyrocketing success rates. 🔧

🎙️ Don't miss this episode, where we decode the art of product experiments and learn the science behind app success.

Episode Links:

Checkout Andres’ company DoWhatWorks at dowhatworks.io

The Pact

Honour The Startup Podcast Pact! If you have listened to TSP and gotten value from it, please:

Follow, rate, and review us in your listening app
Subscribe to the TSP Mailing List to gain access to exclusive newsletter-only content and early-access to information on upcoming episodes: https://thestartuppodcast.beehiiv.com/subscribe
Follow us on YouTube
Give us a public shout-out on LinkedIn or anywhere you have a social media following

Key links

Follow us on YouTube for full-video episodes: https://www.youtube.com/channel/UCNjm1MTdjysRRV07fSf0yGg
Get your question in for our next Q&A episode: https://forms.gle/NZzgNWVLiFmwvFA2A
The Startup Podcast website: https://tsp.show

Learn more about Chris and Yaniv

Work 1:1 with Chris: http://chrissaad.com/advisory/
Follow Chris on Linkedin: https://www.linkedin.com/in/chrissaad/
Follow Yaniv on Linkedin: https://www.linkedin.com/in/ybernstein/