
A/B Testing 101 by Booking.com Product Manager
The Product Podcast
00:00
Non Inferiority Test - Is It Better Than Base?
We set up this experiment as a non inferiority test. What this means is we are saying that our valient is not er worse than our bass. And i'm saying that the variant will have, will not have more than two per cent customer service contacts compared to base. Ee, this is, er, the limit that weare set. The results you can see is zero point seven, eight per cent increase, but it's within the threshold. There's a standard deviation of zero point nine, two per cent, right? So this is a good enough result. That's why the significance shows up as yes, because it is a one sided test....
Transcript
Play full episode