

Experiment Nation: The Podcast
Rommil Santiago's Experiment Nation
Every week we share:
- Interviews with the Best Conversion Rate Optimization (CRO) professionals and Experimenters from around the world
- Conference sessions / Tutorials
Recent recognition:
- Top 10% of most followed Podcasts on Spotify
- Interviews with the Best Conversion Rate Optimization (CRO) professionals and Experimenters from around the world
- Conference sessions / Tutorials
Recent recognition:
- Top 10% of most followed Podcasts on Spotify
Episodes
Mentioned books

Apr 15, 2023 • 30min
S3E12 - Optimize Customer Lifetime Value - NOT Conversion Rates with Valentin Radu
After decades of acquisition marketing, companies are waking up to the fact that optimising the entire lifecycle of the customer is the way to go.
That happens due to rising acquisition costs, cookie deprecation, siloes, company mentalities, etc.
In my session, I will share the insights that I got during my 12 years journey, transitioning from CRO - website optimization to increase the conversion rate to CVO - experimenting towards improving the CLV.
About the speaker:
I am the CEO & Founder at Omniconvert, a solution that helps eCommerce companies all over the world become customer-centric and thrive in a cookie-less future.
I am also the founder of Omniconvert CVO Academy where he helps marketers become certified in CVO through his teaching of the importance of customer lifetime value.
On top of this, he is writing, blogging, podcasting, and advising for brands.
I have a genuine calling to help others and share the shortcuts I discover on my journey.
Chapters
---
0:00 - Introduction
3:59 - Experimentation fatigue
4:53 - A/B Testing is finding the one size that fits all
5:29 - The dominant numbers in eCommerce
8:50 - Aha moment
10:07 - RFM customer segmentation
12:50 - The soulmates
14:12 - Qualitative and Quantitative
17:23 - The CVO Methodology
20:06 - The conversion rate can be a misleading metric in eCommerce
21:53 - Customer value optimization
22:20 - The 4 types of CVO campaigns
24:53 - 4 reasons why the CRO experts are in pole position to nail CVO

Apr 8, 2023 • 40min
S3E11 - Improve conversions with the Message-market Fit framework with Daphne Tideman
Message-Market fit is the idea that a message, whether it be a product, service or idea, needs to resonate with a specific target market in order to be successful. It involves finding the right message that effectively communicates the value proposition of a product or service to a particular audience, in a way that resonates with them.
This process involves identifying the unique needs and preferences of the target audience, understanding their pain points and motivations, and crafting a message that speaks directly to them. The message should be clear, concise, and compelling, and should effectively communicate the benefits of the product or service.
Achieving message-market fit requires a deep understanding of the target audience and ongoing feedback and iteration to refine the message until it resonates with the market. When a message effectively resonates with a target market, it can lead to increased engagement, loyalty, and ultimately, growth.
It is important to note that message-market fit is not a one-time event, but rather an ongoing process that requires continual testing, refinement, and adaptation to changing market conditions. Businesses that prioritize achieving message-market fit are more likely to create products or services that are successful in the long term.
About Daphne Tideman:
Teaching D2C Startups how to grow faster | 10x the subscriber base of a startup in 18 months | Worked with 200+ brands | Eco-friendly and wellness brands specialist | Author
Linkedin: https://www.linkedin.com/in/daphnetideman/#marketing #growth #messaging #experimentation

Apr 2, 2023 • 14min
S3E10 - Avoid AB Testing Statistics Mistakes with Max LI
A/B testing plays a critical role in decision-making - but so does AB Testing Statistics Mistakes. In data-driven companies, A/B tests not only prove positive impacts of product features (treatments) but also provide evidence to safely roll out neutral features that are not expected to move business metrics. When rolling out a neutral feature, we need to test if the treatment is non-inferior to control, and conventional A/B testing is not suitable in this case. In my talk, I present when conventional A/B testing would fail, what the non-inferiority test is, and how is non-inferiority test better when testing treatment is not worse than control. We've published this topic here https://bit.ly/3vmFsYp
About the speaker:
Max is a senior data scientist at Wish where he focuses on experimentation (A/B testing) and machine learning. He has been improving the A/B testing platform at Wish on various fronts, including infrastructure, statistical testing, usability, etc. His passion is to empower data-driven decision-making through the rigorous use of data. Max earned his Ph.D. in Statistical Informatics from the University of Arizona.

29 snips
Mar 25, 2023 • 1h 13min
S3E9 - Stop having bad test ideas - with Bart Schutz
Exploring the impact of filtering out bad testing ideas, collaboration in CRO for valuable insights, challenges of statistics in behavioral science, differentiating between exploratory and confirmative experiments, applying consumer psychology to CRO, optimizing user behavior through behavioral science experiments, and the ethical side of digital experimentation.

Mar 18, 2023 • 16min
S3E8 - How to be a good Experimentation LEADER with Cristina Pujol
Being an Experimentation leader requires a different set of skills. Vistaprint's Cristina Pujol walks through the lessons she's learned.
0:00 - Introduction
1:03 - How Vistaprint organizes for Experimentation
2:22 - The Ambassador role
4:19 - Experimentation process for domains
8:18 - Let’s take a real example
11:36 - Ideas to share learnings and celebrate success
#leadership #program #experimentation

Mar 11, 2023 • 3min
S3E7 - The Best CROs start with RESEARCH - With Rommil Santiago
Does exactly what it says on the tin.
#research #conversion #optimization

Mar 4, 2023 • 19min
S3E6 - Pragmatists will grow the CRO industry - not purists - with Matt Scaysbrook
Our industry can be damning of those doing things ""imperfectly"" - but it seems not to draw the distinction between those doing things imperfectly through ignorance (who can be educated) and those doing things imperfectly through lack of a better option (who need to be helped to show the value to decision-makers). This attitude has a negative impact on new entrants to the industry and sets completely the wrong tone for the next generation. The greater the participation in the industry, the stronger it will become - the wider that participation, the more ideas (and the more diverse those ideas) will come through. And that is only a good thing for us all longer-term. About Matt: Matt Scaysbrook, Founder & Director of Optimisation at WeTeachCRO Matt has been optimising online experiences across B2B & B2C industries for over 10 years. He has a great passion for guiding & educating businesses on the value of Conversion Rate Optimisation. He places the understanding of human behaviour at the heart of all of his work, knowing that that breaks all problems down to the lowest common denominator – us. Clients include Nando’s, GoDaddy and Sage. Chapters --- 0:00 - Introduction 0:55 - The quality of our community is a function of quantity and diversity 2:53 - The purist 8:09 - The pragmatist 12:58 - So what? 16:36 - We need the best of both

Feb 25, 2023 • 31min
S3E5 - How to be good at coding A/B tests with Jeroen Wiersma
How to be a good test coder with Jeroen Wiersma

Feb 18, 2023 • 11min
S3E4 - The CRO Survival guide with Carlos Trujillo
In this session, I want to cover the most strategic actions that a new Experimentation Strategist (or Program Manager) can execute during their first three months in the role to increase trust among the stakeholders and clients. I will share this based on my experience working with clients such as Miro, Procore, The Bouqs, and Gympass, among others. About the speaker Carlos has over nine years of experience working in online marketing and mass media. As an agency founder, he has led web development and conversion optimization projects for more than 80 brands in multiple regions and verticals. It has provided him with broad expertise in conversion optimization, user research, ecommerce strategy, digital psychology, and data analysis that let him contribute to driving innovation that delivers more profits. As an Experimentation Strategist (former Program Manager) at Speero, he has been actively involved in running the Experimentation Programs of fast-growth companies such as Miro, Procore, The Bouqs, and Gympass, among others.

Feb 10, 2023 • 3min
S3E3: Stop wasting time by having principles with Rommil Santiago
You don't have to A/B test everything. Be smart by having guiding principles. #conversionrateoptimization #experimentation #ecommerce