

Experiment Nation: The Podcast
Rommil Santiago's Experiment Nation
Every week we share:
- Interviews with the Best Conversion Rate Optimization (CRO) professionals and Experimenters from around the world
- Conference sessions / Tutorials
Recent recognition:
- Top 10% of most followed Podcasts on Spotify
- Interviews with the Best Conversion Rate Optimization (CRO) professionals and Experimenters from around the world
- Conference sessions / Tutorials
Recent recognition:
- Top 10% of most followed Podcasts on Spotify
Episodes
Mentioned books

Oct 6, 2021 • 26min
Seven lessons from running 22,000 AB tests with Ayat Shukairy
Experiment Nation: The Conference Reloaded
The average success rate of most AB testing programs hovers around 12%. Yep, for every 100 experiments you run, only 12 of them will generate an increase in conversions. That is worse than a coin toss. Too many companies start AB testing hoping that it will deliver a great increase in conversions. A few months later, they are bitterly disappointed. In this session, I will share the lessons we learned by analyzing over 22,000 AB tests on 700 CRO projects. These lessons paint the common patterns that helped us deliver upwards of 50% success rates on AB testing programs. The lessons provide a strategic roadmap for a CRO project as well as tactical details needed while running the day-to-day operations. Key takeaways Attendees will learn what it really takes to run a successful CRO program (Time, resource, management, etc). Attendees will learn the right balance between strategy and tactics when running an experimentation program. Attendees will see an actual project management board running a CRO program

Oct 5, 2021 • 45min
Migrando para a área de experimentação vindo do Jornalismo (participação especial Fabricio Migues)
Hoje começamos um novo papo em nosso podcast: como migrar para a área de experimentação? Nosso convidado especial é Fabricio Migues, CRO Manager na Small World Financial Services, conta pra gente como foi sair da área de jornalismo e relações públicas e adentrar na experimentação, como aproveitar seus aprendizados e conhecimentos da área de comunicação dentro de CRO e como isso o tem ajudado.
Edição: João Pedro Alencar Referências citadas no episódio:
Referência citada da minha parte
https://www.exp-growth.com/
https://open.spotify.com/episode/4d3Prnlc0VIf6dQSdWdGmb?si=ziE3zbnwSKSmW8P34oQIZg&dl_branch=1

Oct 3, 2021 • 19min
Women in experimentation: What holds us back? With Bithika Mehra
Experiment Nation: The Conference Reloaded
Why is it that all through school, girls outperform boys but that equation is flipped in the corporate world? Are there factors in our nurture (and possibly nature) that play against us? How do these factors play out in the experimentation space? In this session – recommended for women in experimentation and those working with them – Bithika will help identify blind spots and hopes to help women and teams reach their true potential.

Sep 18, 2021 • 35min
Shopify’s Shanelle Mullin on tough buy-in conversations and how we can empower future optimizers
Tracy Laranjo chats with Shopify’s Experimentation & Analysis Lead, Shanelle Mullin, about tough buy-in conversations, her take on the “I don’t dream of labour” trend, making experimentation more representative of diverse voices, and how we can empower the next generation of optimizers.
Follow Shanelle on Twitter: @shanelle_mullin

Sep 18, 2021 • 28min
Adventures in Experimentation: Is my company doing CRO right?
There's no single answer as Conversion Optimization and Experimentation continue to evolve and find fit in the digital era. What resonates with us is, if you're constantly testing and celebrating performance instead of delivery, you're likely to be on the right path of doing it right. In this episode, Marion Ravel, Eden Bidani, and Positive John shared different angles, from e-commerce, copywriting, and product, to structuring and thinking through CRO.
Books mentioned:
Emotional Design — https://www.amazon.com/Emotional-Design-Love-Everyday-Things/dp/0465051367
Working Backwards: https://www.amazon.com/Working-Backwards-Insights-Stories-Secrets/dp/1250267595

Aug 23, 2021 • 41min
Série - Estruturando uma área de CRO na sua empresa - episódio 3 (Participação especial André Vieira)
Neste terceiro episódio contamos com a presença de André Vieira, fundador da Looptimize. Ele nos conta um pouco mais da sua visão sobre:
Qual o ponto de partida para começar a investir em CRO?
Popularização da experimentação: heurísticas e boas práticas — pontos positivos e negativos
A qual área CRO melhor pertence dentro de uma empresa?
Edição do podcast por João Pedro (https://www.linkedin.com/in/joaopedroalencar/)
Referências citadas ao longo do ep:
Looptimize: https://looptimize.com.br/
Online Dialogue: https://onlinedialogue.com/
How to measure anything: https://www.amazon.com/How-Measure-Anything-Intangibles-Business-ebook/dp/B00INUYS2U#:~:text=Written%20by%20recogni
Post CRO vs Experimentation: https://www.linkedin.com/posts/joaoostrowski_cro-vs-experimentation-fight-activity-6830566831628124160-Ia-z
GrowthMentor: https://www.growthmentor.com/?ref=johnostrowski

Aug 13, 2021 • 35min
Comment mesurer le ROI de mon programme d’expérimentation?
Hosted by Marion Ravel and Mathieu Fauveaux

Jul 31, 2021 • 26min
Série: Estruturando uma área de CRO na sua empresa - episódio 2
Nesse segundo episódio, falamos sobre gatilhos que fazem empresas procurarem o CRO e desafios para se começar a trabalhar com a área. Discutimos sobre entendimento geral de experimentação em uma empresa sobre o produto "estar pronto" para ser otimizado. Fiquem à vontade para contribuir.
Editor: https://www.linkedin.com/in/jo%C3%A3o-pedro-de-queiroz-alencar-1852a518b/
Referências: Agende uma mentoria com John no GrowthMentor: https://www.growthmentor.com/?ref=johnostrowski
Podcast com Ron Kohavi: https://www.abtasty.com/blog/1000-experiments-club-ronny-kohavi/
Auditoria de maturidade de experimentação com base no artigo The Evolution of Continuous Experimentation in Software Product Development: https://exp-platform.com/Documents/2017-05%20ICSE2017_EvolutionOfExP.pdf

Jul 9, 2021 • 43min
Dexter's Joris Bryon on Common Practices, Starting a CRO agency, and how to spot a CRO imposter
Tracy Laranjo asks Dexter's Joris Bryon about
How we need to stop saying Best practices and start saying Common Practices
His tips on starting a CRO agency and working with a partner
And how to spot a CRO imposter

Jun 30, 2021 • 29min
Série: Estruturando uma área de CRO na sua empresa - episódio 1
Nesse primeiro episódio da série, vamos discutir como caímos no mundo de Otimização de Conversão (CRO), algumas experiências até posições atuais e diferentes perspectivas entre exatas/humanas e seus benefícios.
Editor: João Pedro Alencar https://bit.ly/3jt4BLu
Materiais comentados no episódio:
Learning how to learn from the Awesome Dr. Barbara Oakley: https://bit.ly/3h2AAk1
Making websites win, free audiobook on Spotify >> https://spoti.fi/3qzRYzX
CXL Conversion Optimization minidegree >> https://bit.ly/3Aid9em
Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing >> https://bit.ly/3AicXvE
You should test that https://amzn.to/3x7gTNv