4min chapter

Learning from Machine Learning cover image

Nils Reimers: Sentence Transformers, Search, Future of NLP | Learning from Machine Learning #3

Learning from Machine Learning

CHAPTER

NLP Benchmarks

In the NLP field, I feel like it's very hard to know when you're making meaningful progress. The sentence transformers models looked better in all the benchmarks than for example, the universal sentence and code which was one or two years older. So how can there be such a gap? How do our benchmarks are we really benchmarking what we want?" "It's now nowadays completely useless that you get a new state of the art results in loop," he adds.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode