120 - Evaluation of Text Generation, with Asli Celikyilmaz
NLP Highlights
00:00
The Importance of Automatic Metrics in Text Generations
Automatic metrics are very useful. If the model being trained is not converged or underperforming, there's no point in taking data and asking humans how we did while we know that it actually doesn't perform it. So, they're actually really valuable and important in a sense. Also, this is the fact that which we discussed about human subjectivity, the challenges in human evaluations. One might rely on automatic metrics in those cases, if like, for instance, your task is really, really hard and even for human judges.
Transcript
Play full episode
