AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Are There Any Metrics That Account for That Fat Fact?
Metrics like precision and recall that don't really focus on the position within the top k items the item appears. But there are metrics that account for that fat fact, such as mean reciprocal rank or n d c g. I agree with you, rating prediction is not something that we want to look much into, but ranking it is much more important. And then in production, you can then use a b s to see if the new qestion of calculem is better than the old one.