Vector Podcast cover image

Connor Shorten - Research Scientist, Weaviate - ChatGPT, LLMs, Form vs Meaning

Vector Podcast

CHAPTER

The Advantages of Splayed Vectors Over Tfidf

You have more control in the indexing than in the query but in the query you can model like query similarity for example right so yeah oh that's super interesting. i'm also very curious what you think about this idea of splayed vectors so splayed vectors is like you keep the mass language modeling head and so you encode the thing into the vectors. You just kind of average all the vocabulary distributions and that gives you a sparse vector that represents like happy euphoric ecstatic like the kind of synonyms behind it do you like that kind of idea? I don't know if you've watched the episode with dr nball but he actually shed the light on on this really well by saying hey if

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode