

Experiment Nation: The Podcast
Rommil Santiago's Experiment Nation
Every week we share:
- Interviews with the Best Conversion Rate Optimization (CRO) professionals and Experimenters from around the world
- Conference sessions / Tutorials
Recent recognition:
- Top 10% of most followed Podcasts on Spotify
- Interviews with the Best Conversion Rate Optimization (CRO) professionals and Experimenters from around the world
- Conference sessions / Tutorials
Recent recognition:
- Top 10% of most followed Podcasts on Spotify
Episodes
Mentioned books

Apr 12, 2024 • 33min
S4E8 - Always start by testing your best variation with Zach Lebovics
Zach Lebovics shares insights on experimentation and product management. He discusses the importance of documenting assumptions, testing the best-case scenario first, and understanding that experiment failure isn't solely tied to the outcome. Zach also shares personal experiences and learnings from working in companies like Zynga, Ritual, and Tonal, providing valuable tips for product managers.
Episode links
Zach's Etsy shop link: www.mindfulmix.co
Zach's Team Hub on Coda link: https://coda.io/@zach-lebovics/tonals-product-team-hub
Chapters
00:00 Unlocking the Power of Experimentation: Insights and Strategies
00:23 Meet Zach: A Journey from Product Manager to Experimentation
01:56 The Art of Optimization: From Personal Life to Professional Projects
05:33 Diving Deep into Experimentation: Lessons from Zynga to Tonal
12:21 The Three Pillars of Successful Experimentation
30:26 Wrapping Up: Key Takeaways and Future Directions

Apr 5, 2024 • 37min
S4E7 - Navigating Stakeholder Management and Gaining Buy-In with Shiva Manjunath
Shiva Manjunath, an expert in stakeholder management and conversion rate optimization, shares insights with Ana Kerkovic on fostering collaboration in business. They discuss the shift from chaotic testing methods to structured experimentation. The importance of copy testing in engaging audiences is explored, along with strategies to build trust among stakeholders. They also delve into the intersection of behavioral psychology in marketing. Expect valuable tips on enhancing CRO processes and cultivating a data-driven culture.

Mar 29, 2024 • 52min
S4E6 - The truth about app development and optimization with Juliana Jackson
Media.Monk's Juliana Jackson shares the truth about app development, optimization, and how web and app should work together.

Mar 23, 2024 • 26min
S4E5 -The power of CRO mentorship with Tracy Laranjo
Fractional Head of CRO, Tracy Laranjo talks about the power of Mentorship for Conversion Rate Optimizers (CROs). We cover:
Why would CROs need mentorship?
How do you find one?
When are you ready to be a mentor and how do you get that word out?
Would Tracy be a mentor for our listeners?
GrowthMentor: https://app.growthmentor.com/mentees/sign_up?ref=970f4f6f79
Contact Tracy:
LinkedIn: https://www.linkedin.com/in/tracylaranjo/
Email: hello@tracylaranjo.com
Chapters:
00:00 Introduction
02:34 Tracy's Journey to Self-Employment
06:01 The Value of CRO Mentorship
09:45 Finding the Right Mentor
13:09 The Mentor-Mentee Relationship
18:14 Transitioning from Mentee to Mentor
23:06 Tracy's Offer to Mentor

Mar 16, 2024 • 43min
S4E4 - Product Management vs. CRO with Bryce York
🔥 Check out this insightful interview with Bryce York, Director of Product Management at Tatari, on Experiment Nation’s Conference! Here are 5 key takeaways from the interview:
The similarities and differences between CRO and product management.
The importance of overlapping skills and work in both areas, especially in smaller companies.
Bryce’s background and journey from entrepreneurship to product management.
The significance of qualitative and quantitative data in experiment design and analysis.
The value of documentation and knowledge sharing in building an experiment-driven culture.
Watch the video to gain valuable insights into CRO, product management, and experimentation!
Chapters
00:00 - Introduction and Background
12:30 - Product Management vs. CRO
18:45 - Quantitative and Qualitative Data
25:20 - Minimum Viable Experiment vs. Minimum Viable Product
31:34 - Prioritization and Risk Assessment
34:38 - Getting Smart vs. Getting Lucky
38:54 - Experiment Log and Knowledge Sharing
#CRO #ProductManagement #Experimentation #MarketingSkills #DataDrivenMindset

Mar 9, 2024 • 47min
S4E3 - Create a more impactful testing roadmap with this framework - ft. Edmund Beggs
Expert guest, Edmund Beggs, discusses the 'Levers Framework' for more impactful testing roadmaps. Topics include categorizing experiments, user behavior influences, A-B testing, optimization strategies, and industry benchmarking for CRO professionals.

Mar 2, 2024 • 29min
S4E2 - How to learn from failures (from losing and winning tests) with Simon Girardin
🚀 Exciting Insights from Simon Girardin about learning from failure!🚀
📊 Takeaways from the conversation with Simon Girardin, CRO Program Manager at Conversion Advocates:
1️⃣ Speak Stakeholder Language: Report results in terms of uplifts, decreases, and revenue. Ensure clarity for stakeholders who may not be as versed in the technical aspects.
2️⃣ Learning from Tests: Emphasize the importance of learning from every test. Capture value by reviewing data, segmenting results, and analyzing user behavior through session recordings and heatmaps.
3️⃣ Strategic Iteration: When faced with a winning result in a specific segment, be cautious about immediate implementation. Consider the long-term impact on the user experience and potential tech debt. Iteration should be intentional and aligned with overall business goals.
🔗 Follow Simon Gerarden on LinkedIn for more insightful content on strategic testing and experimentation.
🌐 Connect with Tracy Lano and Experiment Nation for more interviews and discussions with top conversion rate optimizers.
Chapters
00:00 Introduction and Welcome
00:23 Understanding the Importance of Learning from Past Experiments
00:56 The Role of Stakeholders in Experimentation
01:29 The Importance of Testing Strategically
02:34 The Process of Iterative Testing
04:34 The Importance of Segmentation in Testing
05:39 Interpreting Test Data
06:58 The Value of Inconclusive or Losing Tests
07:49 The Challenge of Iterating on a Test
09:32 The Importance of Prioritizing Hypotheses
11:40 The Process of Reviewing Test Results
15:00 The Role of Metrics in Testing
18:02 The Challenge of Implementing Test Wins
25:51 Conclusion and Final Thoughts
#ConversionOptimization #Experimentation #CRO #MarketingInsights

Feb 23, 2024 • 40min
S4E1 - How to build a community around experimentation with Rommil Santiago
Koalatative's Gerda Vogt-Thomas asks Rommil Santiago questions about how he started Experiment Nation and how he manages it while working a full-time job at Optimizely.

Dec 23, 2023 • 37min
S3E54 - Making the case for data-backed design with Brian Massey
Data-backed web design refers to the approach of utilizing empirical evidence and user insights to inform the design and optimization of websites. By analyzing data such as user behavior, click-through rates, conversion rates, and heatmaps, designers can make informed decisions about layout, navigation, content placement, and visual elements. A data-backed approach helps identify user preferences, pain points, and areas for improvement, resulting in enhanced user experiences. A/B testing, user surveys, and analytics tools are commonly employed to gather data and validate design choices. By leveraging data, web designers can create user-centric interfaces that drive engagement, conversions, and overall business success.

Dec 20, 2023 • 46min
S3E53 - CRO Statistical concepts all CROs should know featuring Ishan Goel
In this insightful video, Ishan Goel, transitioning from a software engineer to a researcher, delves into crucial CRO statistical concepts. He sheds light on statistical significance in experimentation, explores A/B testing intricacies, emphasizes the efficiency of sequential testing, and discusses challenges in stopping tests prematurely. The talk concludes by highlighting the intersection of experimentation and statistics in the realm of Conversion Rate Optimization.