

GPT Index and Weaviate with Jerry Liu and Bob van Luijt - Weaviate Podcast #37
5 snips Feb 22, 2023
AI Snips
Chapters
Transcript
Episode notes
GPT Index Origin
- Jerry Liu initially created GPT Index to build a sales bot using customer conversations from Notion and Salesforce.
- He wanted to synthesize to-dos for upcoming meetings, but faced token limitations and costs.
Tree Index
- GPT Index uses a tree index, hierarchically summarizing text chunks to compress information.
- This structure allows LLMs to efficiently search and retrieve relevant information.
Simpler Approach
- While the tree index was a useful experiment, a simpler approach is often more effective.
- Splitting documents into chunks, embedding them, and using a vector store works surprisingly well.