Experiment Nation: The Podcast

Optimizing forms during checkout is crucial for a seamless user experience. By simplifying and streamlining the process, businesses reduce cart abandonment rates and increase conversions. Shortening form length, utilizing autofill options, and providing clear instructions enhance efficiency, minimize user frustration, and ultimately boost customer satisfaction, loyalty, and revenue. Nicoleta walks us through a case-study where she explores a 1 column form vs a 3 column form in checkout. #checkout #forms

Data scientist Ronny Kohavi discusses A/B testing statistics concepts all experimenters must know, including the Overall Evaluation Criterion, Twyman's law, and the amount of traffic needed for A/B tests. He shares insights on handling tests that turn out to be wrong and presenting experiment results to the CEO of Amazon. The podcast also highlights the benefits of AV tests and variety in designs for experimentation and CRO, while cautioning against the pitfalls of long-term testing.

Are you looking to replace Google Optimize? On Experiment Nation's recent podcast, Charlotte April Bomford chats with Kenneth Kutyn about replacing Google Optimize, how to select a new vendor, and whether it's worth building your own Experimentation Platform (spoiler alert: the answer is usually no). #googleoptimize #vendor #experimentation

Tim Thijsse, a senior CRO (Conversion Rate Optimization) consultant at Orange Valley, discusses AI and the future of CRO, and the importance of incorporating qualitative research into company-wide processes. He emphasizes the challenge of linking user behavior and mindset to knowledge and information. Tim shares his background, starting as an interaction designer and later transitioning to UX design and CRO. He highlights the evolution of CRO, the need for a culture of experimentation, and the role of qualitative insights in optimization strategies. Tim also discusses the challenges companies face in adopting an experimentation mindset, such as aligning strategy, operations, and technical aspects, and the importance of having a common metric and collaboration among teams.

Ayat Shukairy emphasizes the importance of addressing the functional, social, and emotional aspects of customer needs when designing websites. She shares seven lessons learned from her experience in conversion rate optimization.

Georgi Georgiev performed a meta-analysis of over 1000 A/B tests and has a great deal to share about: - What you should expect your win rate to be - The benefits of sequential testing - Why you should report on confidence intervals

Learn how to get executive buy-in for your CRO program with Jonny Longden, who shares the importance of having a team with diverse skills in optimization. Discover the key ways experimentation can go wrong and why companies use CRO. Explore the significance of strategic thinking in experimentation for business growth.

Experimenters obsess about many A/B Testing Statistics concepts - but not all of them are worth worrying about. Statsig's Timothy Chan shares his thoughts about test isolation, interaction effects and confidence levels - some of his thoughts may surprise you. #experimentation #product #statistics

Client Relationship Tips and secrets behind a thriving relationship between a CRO agency and the client - anybody can learn how to get started in CRO but it takes years of experience to know how to run a CRO agency and how to scale while keeping the same standards of quality. In my presentation, I will walk you through what you need to know to build a strong, successful relationship with your clients and with your team. You will learn: - how to set expectations with your client from Day 1 - how to leverage operating procedures and automate your work - how to communicate with clients and get stakeholder buy-in every time Chapters --- 0:00 - Introduction 1:52 - The testing Masterfile 3:37 - The testing sheet template

10 lessons that helped John Ekman in Launching a CRO agency. John learned many lessons when launching his agency - he wants to share them with you.