AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Importance of Attention Mechanisms in Search
The idea of term specificity is really useful, but it's often like the way we get at it with document frequency can be really invalid. I feel like it's like zeroing in on what makes this thing precisely interesting as opposed to traditional dense vector representations which have been more fuzzy and cast to find a five wide net kind of thing. And some cases like that is just like thinking of when we would do, we did a project for O'Reilly Media to kind of help with a project similar to Safari books online that people might be familiar with. People don't like if people search JavaScript or book JavaScript books, it just so happens that just how titles are written.