Experiment Nation: The Podcast

Rommil Santiago's Experiment Nation
undefined
Apr 12, 2024 • 33min

S4E8 - Always start by testing your best variation with Zach Lebovics

Zach Lebovics shares insights on experimentation and product management. He discusses the importance of documenting assumptions, testing the best-case scenario first, and understanding that experiment failure isn't solely tied to the outcome. Zach also shares personal experiences and learnings from working in companies like Zynga, Ritual, and Tonal, providing valuable tips for product managers. Episode links Zach's Etsy shop link: www.mindfulmix.co Zach's Team Hub on Coda link: https://coda.io/@zach-lebovics/tonals-product-team-hub Chapters 00:00 Unlocking the Power of Experimentation: Insights and Strategies 00:23 Meet Zach: A Journey from Product Manager to Experimentation 01:56 The Art of Optimization: From Personal Life to Professional Projects 05:33 Diving Deep into Experimentation: Lessons from Zynga to Tonal 12:21 The Three Pillars of Successful Experimentation 30:26 Wrapping Up: Key Takeaways and Future Directions
undefined
Apr 5, 2024 • 37min

S4E7 - Navigating Stakeholder Management and Gaining Buy-In with Shiva Manjunath

Shiva Manjunath, an expert in stakeholder management and conversion rate optimization, shares insights with Ana Kerkovic on fostering collaboration in business. They discuss the shift from chaotic testing methods to structured experimentation. The importance of copy testing in engaging audiences is explored, along with strategies to build trust among stakeholders. They also delve into the intersection of behavioral psychology in marketing. Expect valuable tips on enhancing CRO processes and cultivating a data-driven culture.
undefined
Mar 29, 2024 • 52min

S4E6 - The truth about app development and optimization with Juliana Jackson

Media.Monk's Juliana Jackson shares the truth about app development, optimization, and how web and app should work together.
undefined
Mar 23, 2024 • 26min

S4E5 -The power of CRO mentorship with Tracy Laranjo

Fractional Head of CRO, Tracy Laranjo talks about the power of Mentorship for Conversion Rate Optimizers (CROs). We cover: Why would CROs need mentorship? How do you find one? When are you ready to be a mentor and how do you get that word out? Would Tracy be a mentor for our listeners? GrowthMentor: https://app.growthmentor.com/mentees/sign_up?ref=970f4f6f79 Contact Tracy: LinkedIn: https://www.linkedin.com/in/tracylaranjo/ Email: hello@tracylaranjo.com Chapters: 00:00 Introduction 02:34 Tracy's Journey to Self-Employment 06:01 The Value of CRO Mentorship 09:45 Finding the Right Mentor 13:09 The Mentor-Mentee Relationship 18:14 Transitioning from Mentee to Mentor 23:06 Tracy's Offer to Mentor
undefined
Mar 16, 2024 • 43min

S4E4 - Product Management vs. CRO with Bryce York

🔥 Check out this insightful interview with Bryce York, Director of Product Management at Tatari, on Experiment Nation’s Conference! Here are 5 key takeaways from the interview: The similarities and differences between CRO and product management. The importance of overlapping skills and work in both areas, especially in smaller companies. Bryce’s background and journey from entrepreneurship to product management. The significance of qualitative and quantitative data in experiment design and analysis. The value of documentation and knowledge sharing in building an experiment-driven culture. Watch the video to gain valuable insights into CRO, product management, and experimentation! Chapters 00:00 - Introduction and Background 12:30 - Product Management vs. CRO 18:45 - Quantitative and Qualitative Data 25:20 - Minimum Viable Experiment vs. Minimum Viable Product 31:34 - Prioritization and Risk Assessment 34:38 - Getting Smart vs. Getting Lucky 38:54 - Experiment Log and Knowledge Sharing #CRO #ProductManagement #Experimentation #MarketingSkills #DataDrivenMindset
undefined
Mar 9, 2024 • 47min

S4E3 - Create a more impactful testing roadmap with this framework - ft. Edmund Beggs

Expert guest, Edmund Beggs, discusses the 'Levers Framework' for more impactful testing roadmaps. Topics include categorizing experiments, user behavior influences, A-B testing, optimization strategies, and industry benchmarking for CRO professionals.
undefined
Mar 2, 2024 • 29min

S4E2 - How to learn from failures (from losing and winning tests) with Simon Girardin

🚀 Exciting Insights from Simon Girardin about learning from failure!🚀 📊 Takeaways from the conversation with Simon Girardin, CRO Program Manager at Conversion Advocates: 1️⃣ Speak Stakeholder Language: Report results in terms of uplifts, decreases, and revenue. Ensure clarity for stakeholders who may not be as versed in the technical aspects. 2️⃣ Learning from Tests: Emphasize the importance of learning from every test. Capture value by reviewing data, segmenting results, and analyzing user behavior through session recordings and heatmaps. 3️⃣ Strategic Iteration: When faced with a winning result in a specific segment, be cautious about immediate implementation. Consider the long-term impact on the user experience and potential tech debt. Iteration should be intentional and aligned with overall business goals. 🔗 Follow Simon Gerarden on LinkedIn for more insightful content on strategic testing and experimentation. 🌐 Connect with Tracy Lano and Experiment Nation for more interviews and discussions with top conversion rate optimizers. Chapters 00:00 Introduction and Welcome 00:23 Understanding the Importance of Learning from Past Experiments 00:56 The Role of Stakeholders in Experimentation 01:29 The Importance of Testing Strategically 02:34 The Process of Iterative Testing 04:34 The Importance of Segmentation in Testing 05:39 Interpreting Test Data 06:58 The Value of Inconclusive or Losing Tests 07:49 The Challenge of Iterating on a Test 09:32 The Importance of Prioritizing Hypotheses 11:40 The Process of Reviewing Test Results 15:00 The Role of Metrics in Testing 18:02 The Challenge of Implementing Test Wins 25:51 Conclusion and Final Thoughts #ConversionOptimization #Experimentation #CRO #MarketingInsights
undefined
Feb 23, 2024 • 40min

S4E1 - How to build a community around experimentation with Rommil Santiago

Koalatative's Gerda Vogt-Thomas asks Rommil Santiago questions about how he started Experiment Nation and how he manages it while working a full-time job at Optimizely.
undefined
Dec 23, 2023 • 37min

S3E54 - Making the case for data-backed design with Brian Massey

Data-backed web design refers to the approach of utilizing empirical evidence and user insights to inform the design and optimization of websites. By analyzing data such as user behavior, click-through rates, conversion rates, and heatmaps, designers can make informed decisions about layout, navigation, content placement, and visual elements. A data-backed approach helps identify user preferences, pain points, and areas for improvement, resulting in enhanced user experiences. A/B testing, user surveys, and analytics tools are commonly employed to gather data and validate design choices. By leveraging data, web designers can create user-centric interfaces that drive engagement, conversions, and overall business success.
undefined
Dec 20, 2023 • 46min

S3E53 - CRO Statistical concepts all CROs should know featuring Ishan Goel

In this insightful video, Ishan Goel, transitioning from a software engineer to a researcher, delves into crucial CRO statistical concepts. He sheds light on statistical significance in experimentation, explores A/B testing intricacies, emphasizes the efficiency of sequential testing, and discusses challenges in stopping tests prematurely. The talk concludes by highlighting the intersection of experimentation and statistics in the realm of Conversion Rate Optimization.

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app