Experiment Nation: The Podcast

About this series Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes.

Although the two sample proportion test is well known within the marketing experimentation community, there are a host of categorical data analysis techniques that are amenable to the analysis of A\B test data. This presentation provides a quick overview of Chi-square analysis and a discussion of its use cases in marketing experimentation. Specifically, we discuss how to 1) test a\b\n experiments without inflating Type I error after multiple comparisons, 2) analyze tests with more than dichotomous outcome variables and 3) the process for calculating goodness-of-fit and tests-of-independence. Simple guidelines will be provided regarding test assumptions and use case scenarios.

Sina Fak is the Head of Optimization & Business Intelligence at ConversionAdvocates, the #3 top CRO agency in the world in 2020. Sina shares what businesses get wrong when they hire a shiny new in-house CRO strategist, what to look out for before taking an in-house CRO role, and when a business should consider going agency vs. In-house for CRO. Learn more about ConversionAdvocates: https://conversionadvocates.com/ Find Sina Fak on LinkedIn: https://www.linkedin.com/in/sinafak/

If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ

We know that the key skillsets you need for any successful CRO / Experimentation program are: Research, Design, Development and QA. Whilst larger companies who can afford to hire all of those skilled people, for smaller companies, it becomes a big challenge. So much so, many companies exhaust their options of running smaller tests and then stop doing all kind of experimentation work.  In this session, I will be covering the areas where the companies can reduce their cost of experimentation, things that they will need to consider and increase their profitability of running a successful experimentation program.  ---  If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ

Rishi Rawat is the product page guy. With his 13 years of running A/B tests, Rishi shares what makes an effective product description, his go-to method for segmenting product pages, and how to stand out to your visitors during their most “promiscuous state”. Learn more about Rishi's work at frictionless-commerce.com.

A lot of research and data analysis has gone in to answering this question. But yet, there’s no clear, definitive answer.  In attempt to resolve this question once-and-for-all, this session will present and interesting and surprising answer.  Applying the results from a real-life A/B test case study, digital marketers will be prompted to think not only about email send time, but also their audience and how both aspects impact conversions. ---  If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ

Finally, remember to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ

Welcome to "Where I Started", the interview mini-series in which we get behind the scenes and find out how some of today's experimenters got into CRO. This should be a fun little project that Ontrack Digital started with Experiment Nation to give you a bit of a getaway from all those test results. But also it can be a source of inspiration for those of you that want to get started in CRO and don't really know which path to take. --- If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ

This session is about the conundrum that “data is everything” – a mentality circulating at large the past couple years. There’s so much data, and we often find ourselves simply staring at metrics looking for “+” or “-” to make decisions. The objective of this session is to draw on thinking strategies from physics, of how to approach CRO differently, without any real “data”, to then gleam positive impacts to CRO. Finally, remember to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ