Vector Podcast cover image

Connor Shorten - Research Scientist, Weaviate - ChatGPT, LLMs, Form vs Meaning

Vector Podcast

CHAPTER

The Inverted Index and the Hybrid Search in Bn25

Sorting the inverted index to prioritize documents maybe by clicks would be like the most sensible thing if it's like web pages so to say and you sort the documents. You could probably calculate how much time you have to search and and how much that lets you go into the invert indexYeah super interesting i i think it's very interesting for weevia with the with the hybrid search in the bn25 index because of the cardinality of how many terms you like with the document. The just the size of it inspired me when I was thinking about compression bottleneck from sparse to dense.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode