AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Importance of Alignment in the Evaluation of Models
The biggest example of that was a situation where there was a misalignment in the way the performances were needed to be evaluated. I think that taught me to try to get as much alignment as possible from the very beginning. There were some things that were changed after fact to make it so that our model actually was used for real, but that was a moment of fiction. And so spending more time on evaluation and understanding for real what's to be evaluated is very important.