Scrum Master Toolbox Podcast: Agile storytelling from the trenches cover image

Scrum Master Toolbox Podcast: Agile storytelling from the trenches

How A/B Testing Can Derail Product Development, A Product Leadership Story | Eli Goodman

Oct 1, 2024
Eli Goodman, the Head of Product at Tuple with 17 years of software development experience, dives into the pitfalls of over-relying on A/B testing. He reveals how this dependence can stifle creativity and slow down progress in product development. Eli shares strategies for product teams to reclaim their decision-making by blending data insights with intuition. He also highlights the influence of 'The Idea Factory' on his perspective as a product leader, emphasizing the need for creativity in a fast-paced tech environment.
11:58

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • Over-reliance on A/B testing can inhibit progress and creativity within product teams, leading to decision-making delays and frustration.
  • Embracing individual insights and alternative de-risking methods, such as prototyping, can enhance agility and innovation in product development.

Deep dives

The Value of Empirical Testing

A fixation on A/B testing has emerged within many product organizations, driven by the pursuit of empirical data to validate decisions. Initially, the excitement surrounding the implementation of A/B tests often stems from their ability to provide concrete insights into user interaction and business impacts. However, this enthusiasm can lead to significant costs and resource allocation that may not align with the organization's scale or needs. As teams grow overly focused on A/B test results, they may lose sight of other important factors influencing product development and decision-making.

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner