Experiment Nation: The Podcast

In this discussion, Chris Mercer, a conversion rate optimization expert for low-traffic websites, shares invaluable insights into the art of measurement. He emphasizes the importance of understanding user behavior before any optimization efforts. Sequential testing is highlighted as a more effective approach than traditional A/B testing for sites with limited traffic. Chris also stresses the necessity of focusing on metrics that drive lead generation and revenue, while also advocating for feedback-driven strategies and the automation of measurement using Google Analytics 4.

Join Nick Murphy, Senior Research and Experimentation Lead at Further, as he shares insights into building effective learning libraries that enhance experimentation. He emphasizes capturing the ‘why’ behind tests to foster a culture of growth. Discover how organizing your library can facilitate cross-team collaboration and inform decision-making. Nick also discusses the importance of early documentation and how macro learnings can support consultancy practices, paving the way for a deeper understanding of consumer behavior.

In this episode, senior customer experience leader, Courtney LeBlanc, reveals the ideal partnership between CX and experimenters and shares invaluable insights on: Forging powerful partnerships between CX and experimenters Navigating the daily demands of a CX leader Simplifying CX workflows with customer insights ... and so much more! Don't miss out on this enlightening conversation from an expert in the CX game! Find Courtney on LinkedIn ⤵ LinkedIn: https://www.linkedin.com/in/courtney-leblanc-426920b3/ 00:00 Introduction and Mutual Appreciation 00:27 Meet Courtney: Customer Support and CX Expert 03:38 Building an Alliance with Customer Support 06:11 Challenges and Strategies in CX Collaboration 14:25 Data Analysis and Insights Sharing 23:01 The Ideal Partnership Between CX and Experimentation 24:47 Balancing Customer Insights and Business Priorities 26:46 The Emotional Impact of Customer Support 28:29 Communicating Customer Stories Effectively 30:04 Leveraging NPS Data for Product Improvement 32:08 Empowering Teams with Data Access 33:06 The Importance of Experiment Communication 37:53 Fostering Collaboration Between CX and Product Teams 48:58 Reflecting on Growth and Collaboration 50:22 Conclusion and Final Thoughts

How do you get Product Managers to adopt Experimentation? Shagun Aulakh, the Director of Product Management - Experimentation at American Express shares with Rommil here tips. Here are just a few of the takeaways: 1- Leadership advocacy is critical for embedding experimentation practices in a highly matrixed organization. 2 - Prioritize education and internal PR to influence and persuade teams to embrace experimentation. 3- Define success metrics for your experimentation program and map out a long-term plan for evolving maturity. 5 - Identify champions within the organization to inspire and motivate other teams to adopt experimentation practices. 5 - Democratize insights and share success stories to showcase the value and impact of experimentation. Watch Shagun here: Experimentation Elite in Birmingham UK: https://experimentationelite.com/#spe... Growth Marketing Summit in Frankfurt, Germany: https://www.growthmarketingsummit.com/en

In this episode, we have Joey Herzberg who shares his thoughts on how AI fits in the experimentation life cycle, the utility of keeping easily referenced records of test results, and the importance of experimentation strategy with regard to sample ratios.

Expert Shawn David discusses human-first engineering, breaking tasks for efficiency, discovering automation opportunities to remove menial work, impacts on company culture, navigating hype around AI, and enhancing productivity through automating processes.

Jyoti Malik, the founder of Blue Bagels, built a successful CRO agency by only working with ethical brands. In this chat with Tracy Laranjo, she shares: How to run CRO programs with purpose instead of random guesses - Her favourite underrated user research methods - Tips for creating a CRO strategy that succeeds in the long-term ... And much more. Contact Jyoti: Website: https://www.bluebagels.com/ LinkedIn: https://www.linkedin.com/in/jyotiisingh Email: jyoti@bluebagels.com Chapters 00:00 Introduction to Experiment Nation and Guest Introduction 00:48 Jyoti Malan's Journey and the Essence of Blue Bagels 02:26 The Philosophy Behind Purpose-Driven Brands 05:43 Crafting Purposeful CRO Programs 08:32 Identifying and Correcting Off-Track CRO Programs 17:36 Unconventional Research Methods in CRO 21:06 Adapting and Evolving CRO Strategies 24:41 Upcoming Projects and Closing Thoughts

Nima Yassini, Founder and former CEO of New Republic, shares his insights on cultivating a culture of experimentation in digital marketing. He discusses the integration of UX design and conversion rate optimization, emphasizing the value of data-driven decisions. Nima addresses the political and operational hurdles agencies face in embedding this culture and the need for strong leadership. He also highlights the challenges of multidisciplinary hiring and offers resources to support experimentation initiatives in both agency and in-house settings.

CEO and founder of Decision Layer, Solomon Kahn chats with Rommil Santiago about why he thinks that most companies should not be A/B testing and shares what we should instead. He also discusses his recent debate with Ron Kohavi on LinkedIn on this same topic. Solomon's LinkedIn: https://www.linkedin.com/in/solomonkahn Solomon's email: solomon.kahn@gmail.com Original YouTube Video: https://www.youtube.com/watch?v=vqPylhO3ePU Original LinkedIn Post: https://www.linkedin.com/posts/solomonkahn_the-case-against-ab-testing-yes-i-know-activity-7184577272685719552-hFAB Ron's reply: https://www.linkedin.com/posts/ronnyk_abtesting-experimentguide-abtestingissues-activity-7185060367054565376-cAU9

In this discussion, Tracy Laranjo, an expert on CRO compensation, dives into the highlights of the 2024 CRO Salary Report. Tracy reveals the growing importance of salary transparency and the rising median salaries in the field. She addresses significant pay disparities, especially for women, and the dissatisfaction among junior professionals. Tracy emphasizes valuing oneself in competitive markets and the shifting mindset on job tenure, advocating for personal satisfaction over traditional career paths. Insights on self-reflection and storytelling for job seekers add a powerful touch.