2min chapter

MLOps.community  cover image

Calibration for ML at Etsy - apply() special // Erica Greene and Seoyoon Park // MLOps Coffee Sessions #78

MLOps.community

CHAPTER

How to Evaluate the Metrix?

We haven't explored isotonic regression yet, but a, it's relatively simple. So when we did with tense flow, it came to be pretty easy after we migrated towards it. The tricky part is just now with the calbrated scores a within the a space. In order to rank our listings, we actually have this ranking formula where we have a e cliptory diction and the prediction of another a model. We kind of combine it in a non linear fashion to order these ads in terms of relevance, revenue balancing objectives. But since the distribution of these a model outputs are different, o some of the order and changes in the final output has direct implications to cost charged lars

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode