Weaviate Podcast

GPT Index and Weaviate with Jerry Liu and Bob van Luijt - Weaviate Podcast #37

5 snips
Feb 22, 2023
Ask episode
AI Snips
Chapters
Transcript
Episode notes
ANECDOTE

GPT Index Origin

  • Jerry Liu initially created GPT Index to build a sales bot using customer conversations from Notion and Salesforce.
  • He wanted to synthesize to-dos for upcoming meetings, but faced token limitations and costs.
INSIGHT

Tree Index

  • GPT Index uses a tree index, hierarchically summarizing text chunks to compress information.
  • This structure allows LLMs to efficiently search and retrieve relevant information.
INSIGHT

Simpler Approach

  • While the tree index was a useful experiment, a simpler approach is often more effective.
  • Splitting documents into chunks, embedding them, and using a vector store works surprisingly well.
Get the Snipd Podcast app to discover more snips from this episode
Get the app