Connor Shorten - Research Scientist, Weaviate - ChatGPT, LLMs, Form vs Meaning
Vector Podcast
00:00
The Advantages of Splayed Vectors Over Tfidf
You have more control in the indexing than in the query but in the query you can model like query similarity for example right so yeah oh that's super interesting. i'm also very curious what you think about this idea of splayed vectors so splayed vectors is like you keep the mass language modeling head and so you encode the thing into the vectors. You just kind of average all the vocabulary distributions and that gives you a sparse vector that represents like happy euphoric ecstatic like the kind of synonyms behind it do you like that kind of idea? I don't know if you've watched the episode with dr nball but he actually shed the light on on this really well by saying hey if
Transcript
Play full episode
