Experiment Nation: The Podcast cover image

Experiment Nation: The Podcast

Latest episodes

undefined
Mar 9, 2024 • 47min

S4E3 - Create a more impactful testing roadmap with this framework - ft. Edmund Beggs

Expert guest, Edmund Beggs, discusses the 'Levers Framework' for more impactful testing roadmaps. Topics include categorizing experiments, user behavior influences, A-B testing, optimization strategies, and industry benchmarking for CRO professionals.
undefined
Mar 2, 2024 • 29min

S4E2 - How to learn from failures (from losing and winning tests) with Simon Girardin

🚀 Exciting Insights from Simon Girardin about learning from failure!🚀 📊 Takeaways from the conversation with Simon Girardin, CRO Program Manager at Conversion Advocates: 1️⃣ Speak Stakeholder Language: Report results in terms of uplifts, decreases, and revenue. Ensure clarity for stakeholders who may not be as versed in the technical aspects. 2️⃣ Learning from Tests: Emphasize the importance of learning from every test. Capture value by reviewing data, segmenting results, and analyzing user behavior through session recordings and heatmaps. 3️⃣ Strategic Iteration: When faced with a winning result in a specific segment, be cautious about immediate implementation. Consider the long-term impact on the user experience and potential tech debt. Iteration should be intentional and aligned with overall business goals. 🔗 Follow Simon Gerarden on LinkedIn for more insightful content on strategic testing and experimentation. 🌐 Connect with Tracy Lano and Experiment Nation for more interviews and discussions with top conversion rate optimizers. Chapters 00:00 Introduction and Welcome 00:23 Understanding the Importance of Learning from Past Experiments 00:56 The Role of Stakeholders in Experimentation 01:29 The Importance of Testing Strategically 02:34 The Process of Iterative Testing 04:34 The Importance of Segmentation in Testing 05:39 Interpreting Test Data 06:58 The Value of Inconclusive or Losing Tests 07:49 The Challenge of Iterating on a Test 09:32 The Importance of Prioritizing Hypotheses 11:40 The Process of Reviewing Test Results 15:00 The Role of Metrics in Testing 18:02 The Challenge of Implementing Test Wins 25:51 Conclusion and Final Thoughts #ConversionOptimization #Experimentation #CRO #MarketingInsights
undefined
Feb 23, 2024 • 40min

S4E1 - How to build a community around experimentation with Rommil Santiago

Koalatative's Gerda Vogt-Thomas asks Rommil Santiago questions about how he started Experiment Nation and how he manages it while working a full-time job at Optimizely.
undefined
Dec 23, 2023 • 37min

S3E54 - Making the case for data-backed design with Brian Massey

Data-backed web design refers to the approach of utilizing empirical evidence and user insights to inform the design and optimization of websites. By analyzing data such as user behavior, click-through rates, conversion rates, and heatmaps, designers can make informed decisions about layout, navigation, content placement, and visual elements. A data-backed approach helps identify user preferences, pain points, and areas for improvement, resulting in enhanced user experiences. A/B testing, user surveys, and analytics tools are commonly employed to gather data and validate design choices. By leveraging data, web designers can create user-centric interfaces that drive engagement, conversions, and overall business success.
undefined
Dec 20, 2023 • 46min

S3E53 - CRO Statistical concepts all CROs should know featuring Ishan Goel

In this insightful video, Ishan Goel, transitioning from a software engineer to a researcher, delves into crucial CRO statistical concepts. He sheds light on statistical significance in experimentation, explores A/B testing intricacies, emphasizes the efficiency of sequential testing, and discusses challenges in stopping tests prematurely. The talk concludes by highlighting the intersection of experimentation and statistics in the realm of Conversion Rate Optimization.
undefined
Dec 16, 2023 • 27min

S3E56 - Level-up your UX Research with Diary Studies featuring Mike Green

In this episode, Mike Green discusses the use of diary studies in UX research, particularly in the context of public sector user research. Mike Green, a freelance user research lead based in the UK, shares his experiences using Google Forms, structuring incentives, and addressing challenges in recruitment for diary studies. The discussion emphasizes the longitudinal nature of diary studies, contrasting them with traditional usability tests, and highlights their effectiveness in capturing user feedback over a period of time. Mike also touches upon the importance of understanding user behavior, attitudinal responses, and the ethical considerations in dealing with vulnerable groups. The planning and design stage for diary studies is emphasized, stressing the need to align the research goals with the chosen methodology. Overall, the video aims to provide insights and tips for conducting impactful UX research using diary studies in the public sector. Chapters 00:00 Introduction to Diary Studies with Mike Green 03:21 Understanding the Purpose of a Diary Study 06:45 Recruiting Participants for Your Diary Study 10:12 Analyzing Data from Diary Studies 14:30 Key Considerations for Diary Studies Success #UXResearch #DiaryStudies #UserExperience #ResearchablePodcast
undefined
Dec 11, 2023 • 27min

S3E55 - How to get Stakeholder Buy-in for all your Experiments featuring André Morys

Learn from André Morys, CEO of KonversionsKRAFT, on gaining crucial stakeholder buy-in for experiments. André highlights the challenges faced by optimizers and advocates for understanding team dynamics through stakeholder mapping. He emphasizes approaching stakeholders, using empathy to build relationships, and overcoming objections. André shares practical insights on conflict management, including a stakeholder map with color-coded power dynamics. Discover the significance of regular check-ins, fostering trust, and achieving tangible results in experimentation. Master the art of securing support for your experiments effectively. About growth marketing Summit: June 19th, 2024 in Frankfurt: www.growthmarketingSUMMIT.com - with 700-800 attendees it is Europe's #1 real-life conference with a handpicked lineup of great people you will usually not see at one conference. Andre's strategy illustrated: http://experimentnation.com/wp-content/uploads/2023/12/andre-stakeholder-strategy.png Chapters 00:00 - Introducing André Morys and the importance of stakeholder buy-in 04:12 - Understanding the stakeholder map and its color-coded quadrants 09:37 - The impact of stakeholders on experimentation in different company sizes 13:45 - Importance of building relationships and trust with stakeholders 18:20 - Recognizing objections and crafting strategies to address them 24:10 - Navigating implicit forces in larger organizations 24:43 - Learn about André Morys’ upcoming Growth Marketing Summit
undefined
Dec 9, 2023 • 29min

S3E54 - Will Laurenson: From Startups to CRO Mastery

Will Laurenson shares his journey from startup to becoming a CRO (Conversion Rate Optimization) expert. Will discusses the significance of usability, anxiety, and motivation in CRO, drawing from his extensive experience in running tests and optimizing various businesses. Will's approach to CRO involves deep insights into user behavior and a focus on aligning products with customer needs, challenging the common pitfalls of assuming product-market fit based solely on initial traction or advertising success. Chapters: 0:00 - Introduction to Will Laurenson’s CRO Journey 2:30 - Transitioning from startups to founding Customers Who Click 6:15 - Understanding the usability, anxiety, and motivation in CRO 10:45 - Onboarding process and working with clients at Customers Who Click 15:20 - The UAM Method: Usability, Anxiety, and Motivation in CRO Will's podcast: https://customerswhoclick.carrd.co/ Will on LinkedIn: https://www.linkedin.com/in/willlaurenson/
undefined
Nov 25, 2023 • 41min

S3E52 - Ad Optimization: Your Ads Aren’t Working and Here’s Why ft. Joe Fitzpatrick

You need to invest in ad optimization. Effective performance marketing / advertising optimization relies on continuous experimentation, data-driven decision-making, audience insight, and refined targeting. It's not just about numbers; creativity, a deep understanding of advertising channels, and ethical targeting are crucial. Brand trust and performance marketing are interconnected, with customer reviews and testimonials playing a significant role. Embracing experimentation and learning from failures is essential for long-term success in performance marketing. Transparency with clients, a focus on the bigger picture, and purposeful action are keys to building trust. Joe discusses the launch of AD Scientists and encourages connecting with other industry professionals. If you want to follow Joe, check him out here: https://www.adscientist.ca/ https://www.linkedin.com/in/joefitzpatrick1/
undefined
Nov 18, 2023 • 30min

S3E51 - A Comprehensive Guide to Ad Network Experimentation ft. João Marcelo Rodrigues

Maximizing results in ad network optimization requires a systematic approach. Start with A/B testing on Google Ads and gradually introduce more complex campaigns, balancing technical and creative aspects. Analyze your channel's performance, ensuring sufficient impressions and conversions for statistically significant results. Shape your product to align with the ad network's requirements and consider user experience. Prioritize velocity in testing initially, gradually enhancing quality, and encourage collaboration across different platforms for valuable insights in the quest for optimization.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode