Experiment Nation: The Podcast

eCommerce CRO veteran Johann Van Tonder shares what usually goes wrong when coming up with test ideas and how to fix it. We also discuss the merits of quantity vs. quality of ideas, the problem with brainstorming, and what to do instead for more effective ideation sessions. Find Johann on Twitter: @amaclickclick Learn more about AWA Digital: awa-digital.com

Anil is a Digital Marketing and Analytics professional with 18+ years of experience. He has worked with companies ranging from startups to Fortune 500 and has helped them improve marketing results as well as develop data driven culture. He has vast experience in Web, Email, Social, Display, Search, Paid Search, and CRM. He holds a B. Tech in Electronics and Communication Engineering from India and an MBA from the University of Washington, Seattle. He is the founder of https://academy.optizent.com – A Digital Analytics training and education company.

About this series Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes.

When experimenting with our products, we need to find our users but it’s not always that simple! Where do we find the users? In this session Moshe will go over different types of products and different ways to find users for each of them. Coming out of this session, attendees will have some ideas on where to start looking for their users.

About this series Rommil Santiago, the founder of Experiment Nation shares his most recent thoughts about the industry and the craft of Experimentation in less than 5 minutes.

Although the two sample proportion test is well known within the marketing experimentation community, there are a host of categorical data analysis techniques that are amenable to the analysis of A\B test data. This presentation provides a quick overview of Chi-square analysis and a discussion of its use cases in marketing experimentation. Specifically, we discuss how to 1) test a\b\n experiments without inflating Type I error after multiple comparisons, 2) analyze tests with more than dichotomous outcome variables and 3) the process for calculating goodness-of-fit and tests-of-independence. Simple guidelines will be provided regarding test assumptions and use case scenarios.

Sina Fak is the Head of Optimization & Business Intelligence at ConversionAdvocates, the #3 top CRO agency in the world in 2020. Sina shares what businesses get wrong when they hire a shiny new in-house CRO strategist, what to look out for before taking an in-house CRO role, and when a business should consider going agency vs. In-house for CRO. Learn more about ConversionAdvocates: https://conversionadvocates.com/ Find Sina Fak on LinkedIn: https://www.linkedin.com/in/sinafak/

If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ

We know that the key skillsets you need for any successful CRO / Experimentation program are: Research, Design, Development and QA. Whilst larger companies who can afford to hire all of those skilled people, for smaller companies, it becomes a big challenge. So much so, many companies exhaust their options of running smaller tests and then stop doing all kind of experimentation work.  In this session, I will be covering the areas where the companies can reduce their cost of experimentation, things that they will need to consider and increase their profitability of running a successful experimentation program.  ---  If you liked this episode, don't forget to signup for Experiment Nation's bi-weekly newsletter here: https://buff.ly/31qO0AQ

Rishi Rawat is the product page guy. With his 13 years of running A/B tests, Rishi shares what makes an effective product description, his go-to method for segmenting product pages, and how to stand out to your visitors during their most “promiscuous state”. Learn more about Rishi's work at frictionless-commerce.com.