AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Is There a Difference Between a Data Set and a Card?
The identity of the group with the worst performance and what that worst performance looks like can vary radically from data set to data set. There was debate about whether we should release information like, okay, on this service, the worst performing group among these demographic groups was such and such group. And I think there's two very good reasons that in the end, we decided not to do that at this point. We don't want to deliberately do worse on groups that you're doing better on in order to raise their rate of harm up to match that of the worstperforming group. The goal is to make every error group error rate as small as we can possibly possible equalize all of them.