Learning from Machine Learning cover image

Nils Reimers: Sentence Transformers, Search, Future of NLP | Learning from Machine Learning #3

Learning from Machine Learning

CHAPTER

NLP Benchmarks

In the NLP field, I feel like it's very hard to know when you're making meaningful progress. The sentence transformers models looked better in all the benchmarks than for example, the universal sentence and code which was one or two years older. So how can there be such a gap? How do our benchmarks are we really benchmarking what we want?" "It's now nowadays completely useless that you get a new state of the art results in loop," he adds.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner