Experiment Nation: The Podcast

In this video, Riccardo Vandra discusses the importance of asking powerful questions for conversion rate optimization (CRO). He emphasizes that the quality of our questions determines the quality of our insights and ultimately our success. Riccardo proposes a three-step questioning framework for building effective questions.

We sat down with Jason Chappel, founder of Defiant, a specialist Customer Value Optimization agency, to discuss what sets CVO apart from CRO. Jason shares his insight on the importance of understanding and optimizing the entire customer journey, from acquisition to retention, and how CVO can help businesses increase customer lifetime value and drive sustainable growth in your business strategy.

Harriet Swan, a UX Research Manager at Conversion, leads a team that merges UX research with A-B testing. She discusses the crucial union of quantitative and qualitative research in deciphering human motivation. Harriet highlights that while quantitative data offers hard stats, qualitative insights unveil deeper emotional context. The conversation dives into how this combination can significantly enhance user experiences and conversion rates, showcasing real client examples that underscore the power of informed decision-making.

The best Product Managers and Experimenters possess a unique skill: they know how to tell good stories that capture the hearts and minds of stakeholders and gain buy-in. Through powerful storytelling, they paint a vivid picture of the product's vision, value, and potential impact. They tap into emotions, using anecdotes and examples to create relatable narratives that resonate with their audience. They highlight the problem, solution, and user benefits in a way that is clear, concise, and memorable. Their stories inspire trust and confidence, compelling stakeholders to align with the product's vision and goals. In this way, storytelling becomes an invaluable tool for Product Managers to generate buy-in and drive successful product outcomes.

Optimizing forms during checkout is crucial for a seamless user experience. By simplifying and streamlining the process, businesses reduce cart abandonment rates and increase conversions. Shortening form length, utilizing autofill options, and providing clear instructions enhance efficiency, minimize user frustration, and ultimately boost customer satisfaction, loyalty, and revenue. Nicoleta walks us through a case-study where she explores a 1 column form vs a 3 column form in checkout. #checkout #forms

Data scientist Ronny Kohavi discusses A/B testing statistics concepts all experimenters must know, including the Overall Evaluation Criterion, Twyman's law, and the amount of traffic needed for A/B tests. He shares insights on handling tests that turn out to be wrong and presenting experiment results to the CEO of Amazon. The podcast also highlights the benefits of AV tests and variety in designs for experimentation and CRO, while cautioning against the pitfalls of long-term testing.

Are you looking to replace Google Optimize? On Experiment Nation's recent podcast, Charlotte April Bomford chats with Kenneth Kutyn about replacing Google Optimize, how to select a new vendor, and whether it's worth building your own Experimentation Platform (spoiler alert: the answer is usually no). #googleoptimize #vendor #experimentation

Tim Thijsse, a senior CRO (Conversion Rate Optimization) consultant at Orange Valley, discusses AI and the future of CRO, and the importance of incorporating qualitative research into company-wide processes. He emphasizes the challenge of linking user behavior and mindset to knowledge and information. Tim shares his background, starting as an interaction designer and later transitioning to UX design and CRO. He highlights the evolution of CRO, the need for a culture of experimentation, and the role of qualitative insights in optimization strategies. Tim also discusses the challenges companies face in adopting an experimentation mindset, such as aligning strategy, operations, and technical aspects, and the importance of having a common metric and collaboration among teams.

Ayat Shukairy emphasizes the importance of addressing the functional, social, and emotional aspects of customer needs when designing websites. She shares seven lessons learned from her experience in conversion rate optimization.

Georgi Georgiev performed a meta-analysis of over 1000 A/B tests and has a great deal to share about: - What you should expect your win rate to be - The benefits of sequential testing - Why you should report on confidence intervals