
Using AI and ML to Help Humans, Not Replace Them - ML 071
Adventures in Machine Learning
00:00
Is There a Bias in the Agent?
In previous industries I've worked in like in e-commerce years and years ago, we saw the same sort of bias behavior based on the solutions that we were presenting to customers. People don't think about that. They think, Oh, I ran my AB test. Here's this group of 1.8 million people that are going to be in control. And they're like, look at this lift. Like that's not real, like not even close. So we need to identify cohorts. And we need to actually run like 200 separate statistical tests on these groups. Then we can see that stratification. And that'll tell us what the lift is per group.
Transcript
Play full episode