Task-aware Retrieval with Instructions
Neural Search Talks — Zeta Alpha
00:00
What's the Unit of Retrieval?
Barry is this benchmark with a bank of explicit retrieval instructions, right? And kind of go through the, what data sets, what data's included in a couple of examples of queries for that. So intent are the high level things we've been looking at, like code versus answer. Domain is sort of like, is your answer coming from Wikipedia? Is it coming from PubMed, you know, like a medical corpus somewhere else? And then unit is a bit odd, but it's the unit of retrieval. It's not that I, my question could be answered in a sentence or a passage. It's more that this question is tied to a data set that was in the sentence level
Transcript
Play full episode
