
Chris Albon — ML Models and Infrastructure at Wikimedia
Gradient Dissent: Conversations on AI
00:00
Is There a Gold Standard for NLP?
We traditionally do one model per language. Right now I'm looking at a kind of shift where we end up doing one model perlanguage for every single model that we can, but then doing a language agnostic model for everything else. And it's because gathering the training data from each individual community is really, is really kind of consuming. So trying to like do that balance where we can do that global coverage, but believe that the gold standard should be an individual language based model.
Transcript
Play full episode