Neural Search Talks β€” Zeta Alpha cover image

ColBERT + ColBERTv2: late interaction at a reasonable inference cost

Neural Search Talks β€” Zeta Alpha

00:00

The Importance of Confidence in the Average Pooling Method

I think what's going on here is similar to what we even saw with pre-burt methods where average pooling is just not a good way to pool things, it seems. I think what happens is it's just dominated by small, meaningless, low values. Like 0.1 versus 0.4. It's probably totally meaningless. But this is going to matter when you do the average because this has a big impact. And that works better since it always works better than something and an average pooling, like you were saying.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app