

Experiment Nation: The Podcast
Rommil Santiago's Experiment Nation
Every week we share:
- Interviews with the Best Conversion Rate Optimization (CRO) professionals and Experimenters from around the world
- Conference sessions / Tutorials
Recent recognition:
- Top 10% of most followed Podcasts on Spotify
- Interviews with the Best Conversion Rate Optimization (CRO) professionals and Experimenters from around the world
- Conference sessions / Tutorials
Recent recognition:
- Top 10% of most followed Podcasts on Spotify
Episodes
Mentioned books

Nov 25, 2023 • 41min
S3E52 - Ad Optimization: Your Ads Aren’t Working and Here’s Why ft. Joe Fitzpatrick
You need to invest in ad optimization.
Effective performance marketing / advertising optimization relies on continuous experimentation, data-driven decision-making, audience insight, and refined targeting. It's not just about numbers; creativity, a deep understanding of advertising channels, and ethical targeting are crucial. Brand trust and performance marketing are interconnected, with customer reviews and testimonials playing a significant role. Embracing experimentation and learning from failures is essential for long-term success in performance marketing. Transparency with clients, a focus on the bigger picture, and purposeful action are keys to building trust. Joe discusses the launch of AD Scientists and encourages connecting with other industry professionals.
If you want to follow Joe, check him out here:
https://www.adscientist.ca/
https://www.linkedin.com/in/joefitzpatrick1/

Nov 18, 2023 • 30min
S3E51 - A Comprehensive Guide to Ad Network Experimentation ft. João Marcelo Rodrigues
Maximizing results in ad network optimization requires a systematic approach. Start with A/B testing on Google Ads and gradually introduce more complex campaigns, balancing technical and creative aspects. Analyze your channel's performance, ensuring sufficient impressions and conversions for statistically significant results. Shape your product to align with the ad network's requirements and consider user experience. Prioritize velocity in testing initially, gradually enhancing quality, and encourage collaboration across different platforms for valuable insights in the quest for optimization.

Nov 11, 2023 • 48min
S3E50 - The top CRO Myths that experimenters have to bust ft. Lucas Vos
Lucas, a senior conversion specialist, shares his journey in the media industry, emphasizing the transformative impact of A/B testing. He discusses myths about experimentation - debunking them along the way as well as highlights the importance of validation, integration into essential projects, and showcasing negative results. Lucas encourages testing the obvious and unexpected, questioning assumptions, and showing the value of experimentation to reduce risk and aid decision-making, making it an asset for senior managers and specialists.

Nov 4, 2023 • 29min
S3E49 - Personalization timing matters - Avoid these common mistakes ft. Eric Melchor
Personalization timing matters
Eric Melchor, an evangelist at Optimonk, emphasizes the importance of focusing on the product page for effective conversion rate optimization (CRO). He suggests treating website visitors as individuals and creating a personalized and enjoyable customer experience in real-time. Melchor also discusses the significance of capturing visitor interest early on and leveraging smart CRO tactics and personalization timing throughout the customer journey. Additionally, he mentions the value of optimizing the product page, as it can yield significant returns on investment.

Oct 28, 2023 • 36min
S3E48 - CRO Organizational Structure- Centralized Team vs Process: with Oliver Paton
We explore various angles of CRO Organizational Structure. We discussed primarily the differences between centralized CRO teams vs a company-wide experimentation culture, and how this is best looked at as a continuum. Companies starting out might benefit from a centralized CRO team whereas more mature optimization programs can benefit more from working experimentation into all facets of the company. How can a company who does 0 experimentation introduce and adopt an experimentation process/culture? We also chatted about experimentation at the customer level, what this means, and how it could be the future of optimization.

Oct 21, 2023 • 60min
S3E47 - What CROs need to know about Heatmaps with Deborah O'Malley
Heatmaps to the rescue! Creating an impactful website hero section above the fold is vital for user engagement. Clear value propositions and compelling calls to action are essential, as users often don't scroll past this section. Heat mapping, combined with other techniques like exit polls and A/B testing, provides a comprehensive understanding of user behavior. While urgency and scarcity tactics can be effective, users have become more skeptical of overused strategies like countdown timers. Understand your audience through analytics data and tailor your optimization strategies accordingly, whether it's for B2C, B2B, or other sectors. Mobile interactions may have imprecise heat map data, so use it alongside other sources for a well-rounded view.

Oct 6, 2023 • 32min
S3E46 - Experimentation Culture for Startups with Simon Girardin
Experimentation Culture for Startups is so important.
In the realm of Conversion Rate Optimization (CRO), engaging all stakeholders, from executives to product managers and customer service, is pivotal for success. This inclusive approach fosters collaboration, early alignment on technical aspects, and efficient experimentation. It stands in stark contrast to tactical CRO, which tends to focus on short-term projects and lacks a comprehensive strategy. Strategic CRO, on the other hand, entails research, testing, iteration, and transparent communication, forming a continuous and value-driven process. When selecting a CRO agency, clients should prioritize those that emphasize strategic approaches, effective utilization of test results, and well-structured workflows. This approach transforms CRO into an integral part of an organization's culture and operations, creating enduring value.

Sep 9, 2023 • 1h 1min
S3E45 - How to Maximize Hypotheses Testing ft. Eduardo Marconi Pinheiro Lima
Having an experimentation roadmap is crucial for conversion rate optimization and Hypotheses Testing because it provides a structured and strategic approach to improving conversion rates on a website or marketing campaign. Here are a few key reasons why it is important:
Systematic Testing: An experimentation roadmap helps in organizing and prioritizing the different experiments that need to be conducted. It ensures that testing is done in a systematic manner, focusing on one element at a time, and allows for clear tracking and analysis of results.
Data-Driven Decision Making: By following a roadmap, you can collect valuable data through controlled experiments. This data helps in making informed decisions based on actual user behavior and preferences, rather than relying on assumptions or guesswork. It enables you to understand what works and what doesn't, leading to effective optimization strategies.
Resource Allocation: An experimentation roadmap helps allocate resources efficiently. By planning ahead and setting clear goals and timelines, you can allocate resources such as time, budget, and personnel effectively. It prevents random testing or haphazard changes that may waste resources without generating significant improvements.
Continuous Improvement: Conversion rate optimization is an ongoing process. An experimentation roadmap allows for continuous improvement by setting up a cycle of testing, learning, and iterating. It ensures that insights gained from previous experiments are applied to future iterations, leading to cumulative improvements over time.
Alignment and Collaboration: A roadmap provides a shared vision and plan for the conversion rate optimization efforts. It aligns stakeholders, such as marketers, designers, developers, and executives, towards a common goal. Collaboration becomes easier as everyone understands the testing priorities, expected outcomes, and their roles in the process.
In summary, an experimentation roadmap is essential for conversion rate optimization as it provides a structured and data-driven approach to testing, decision making, resource allocation, continuous improvement, and collaboration. It maximizes the effectiveness and efficiency of optimization efforts, leading to better conversion rates and overall business success.

7 snips
Sep 2, 2023 • 11min
S3E44 - What you need to know about Landing pages with Claire More
Digital marketing expert, Claire More, discusses the importance of landing pages in ad campaigns and how to leverage them for e-commerce companies. She also highlights common mistakes with landing pages and provides tips for improvement.

Aug 26, 2023 • 33min
S3E43 - Don't test everything with Oliver Palmer
Don't test everything. Experimentation isn't about proving how clever you are. Mistakes in testing ideas from your own head are common; personal bias clouds results. High-performing experimentation needs executive buy-in and integrated roles. Successful teams engage diverse players with vested interest, ensuring hypotheses formation and metric selection are comprehensive. Valuable experimentation saves time by testing what not to do. Rather than just chasing conversion lifts, recognize when improvements won't make a difference. Cultural shifts, humility, and prioritizing efficient use of time are key components of effective experimentation programs. Test what makes sense.