Experiment Nation: The Podcast

How do you get Product Managers to adopt Experimentation? Shagun Aulakh, the Director of Product Management - Experimentation at American Express shares with Rommil here tips. Here are just a few of the takeaways: 1- Leadership advocacy is critical for embedding experimentation practices in a highly matrixed organization. 2 - Prioritize education and internal PR to influence and persuade teams to embrace experimentation. 3- Define success metrics for your experimentation program and map out a long-term plan for evolving maturity. 5 - Identify champions within the organization to inspire and motivate other teams to adopt experimentation practices. 5 - Democratize insights and share success stories to showcase the value and impact of experimentation. Watch Shagun here: Experimentation Elite in Birmingham UK: https://experimentationelite.com/#spe... Growth Marketing Summit in Frankfurt, Germany: https://www.growthmarketingsummit.com/en

In this episode, we have Joey Herzberg who shares his thoughts on how AI fits in the experimentation life cycle, the utility of keeping easily referenced records of test results, and the importance of experimentation strategy with regard to sample ratios.

Expert Shawn David discusses human-first engineering, breaking tasks for efficiency, discovering automation opportunities to remove menial work, impacts on company culture, navigating hype around AI, and enhancing productivity through automating processes.

Jyoti Malik, the founder of Blue Bagels, built a successful CRO agency by only working with ethical brands. In this chat with Tracy Laranjo, she shares: How to run CRO programs with purpose instead of random guesses - Her favourite underrated user research methods - Tips for creating a CRO strategy that succeeds in the long-term ... And much more. Contact Jyoti: Website: https://www.bluebagels.com/ LinkedIn: https://www.linkedin.com/in/jyotiisingh Email: jyoti@bluebagels.com Chapters 00:00 Introduction to Experiment Nation and Guest Introduction 00:48 Jyoti Malan's Journey and the Essence of Blue Bagels 02:26 The Philosophy Behind Purpose-Driven Brands 05:43 Crafting Purposeful CRO Programs 08:32 Identifying and Correcting Off-Track CRO Programs 17:36 Unconventional Research Methods in CRO 21:06 Adapting and Evolving CRO Strategies 24:41 Upcoming Projects and Closing Thoughts

Join Nima Yassini as he dives into experimentation culture, the journey of building a brand UX and digital marketing agency focused on conversion rate optimization, the integration of digital marketing and experimentation cultur, the struggles and benefits of adopting a culture of experimentation, and the need for leadership and reinvestment in the experimentation industry. Connect with Nima here: https://www.linkedin.com/in/nimayassini/ Chapters 0:00 Opening Remarks and Guest Introduction 00:48 The Evolution of a Digital Marketing Agency 01:27 Merging UX Design with Experimentation 03:56 The Power of Data in Design Decisions 09:13 The Culture of Experimentation in Agencies vs. In-House 11:49 The Challenge of Embedding a Culture of Experimentation 13:36 The Future of the Experimentation Industry 25:12 Advice for Experimentation Practitioners 28:29 Closing Thoughts and Offers to Help the Industry

CEO and founder of Decision Layer, Solomon Kahn chats with Rommil Santiago about why he thinks that most companies should not be A/B testing and shares what we should instead. He also discusses his recent debate with Ron Kohavi on LinkedIn on this same topic. Solomon's LinkedIn: https://www.linkedin.com/in/solomonkahn Solomon's email: solomon.kahn@gmail.com Original YouTube Video: https://www.youtube.com/watch?v=vqPylhO3ePU Original LinkedIn Post: https://www.linkedin.com/posts/solomonkahn_the-case-against-ab-testing-yes-i-know-activity-7184577272685719552-hFAB Ron's reply: https://www.linkedin.com/posts/ronnyk_abtesting-experimentguide-abtestingissues-activity-7185060367054565376-cAU9

In this discussion, Tracy Laranjo, an expert on CRO compensation, dives into the highlights of the 2024 CRO Salary Report. Tracy reveals the growing importance of salary transparency and the rising median salaries in the field. She addresses significant pay disparities, especially for women, and the dissatisfaction among junior professionals. Tracy emphasizes valuing oneself in competitive markets and the shifting mindset on job tenure, advocating for personal satisfaction over traditional career paths. Insights on self-reflection and storytelling for job seekers add a powerful touch.

Zach Lebovics shares insights on experimentation and product management. He discusses the importance of documenting assumptions, testing the best-case scenario first, and understanding that experiment failure isn't solely tied to the outcome. Zach also shares personal experiences and learnings from working in companies like Zynga, Ritual, and Tonal, providing valuable tips for product managers. Episode links Zach's Etsy shop link: www.mindfulmix.co Zach's Team Hub on Coda link: https://coda.io/@zach-lebovics/tonals-product-team-hub Chapters 00:00 Unlocking the Power of Experimentation: Insights and Strategies 00:23 Meet Zach: A Journey from Product Manager to Experimentation 01:56 The Art of Optimization: From Personal Life to Professional Projects 05:33 Diving Deep into Experimentation: Lessons from Zynga to Tonal 12:21 The Three Pillars of Successful Experimentation 30:26 Wrapping Up: Key Takeaways and Future Directions

Shiva Manjunath, an expert in stakeholder management and conversion rate optimization, shares insights with Ana Kerkovic on fostering collaboration in business. They discuss the shift from chaotic testing methods to structured experimentation. The importance of copy testing in engaging audiences is explored, along with strategies to build trust among stakeholders. They also delve into the intersection of behavioral psychology in marketing. Expect valuable tips on enhancing CRO processes and cultivating a data-driven culture.

Media.Monk's Juliana Jackson shares the truth about app development, optimization, and how web and app should work together.