AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Continuous Iteration Towards Improved Retrieval Performance
The company initially implemented HNSW for indexing, assuming all data was in memory. However, to enable disk storage-based usage, they switched to JVector, an implementation of disk ANN. JVector, an open-source project developed by Jonathan Ellis, delivered enhanced performance, leading to its adoption by projects like OpenSearch. Currently, the company is enhancing retrieval with Colbert on top of JVector, showcasing a commitment to continuous iteration for improved performance.