AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Practical AI: Machine Learning, Data Science, LLM
Open source, on-disk vector search with LanceDB
Dec 19, 2023
41:53
Snipd AI
Chang She, CEO of LanceDB, discusses their open source, on-disk vector search offering. They explore the benefits of their unique columnar database structure, serverless deployments, and cost savings at scale. The podcast also discusses the programming languages supported by LanceDB, on-edge technology in autonomous vehicles, and exciting developments in the practical AI space.
Read more
AI Summary
Highlights
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- LanceDB is an open-source embedded vector database that simplifies integration into various workflows and scenarios.
- LanceDB's columnar storage layer and disk-based vector indices enable faster queries, scalable separation of compute and storage, and efficient access to large datasets.
Deep dives
Introduction and Background of LanceDB
LanceDB is an open-source embedded vector database that aims to provide a single source of truth for companies working with computer vision and generative AI. The motivation behind LanceDB came from the observation that projects involving multimodal data, especially those related to computer vision, were challenging to maintain and put into production due to the lack of suitable data infrastructure. LanceDB was initially focused on building a new data storage layer for managing unstructured data more effectively. As the importance of generative AI grew, LanceDB evolved to provide features like semantic search, retrieval, and versioning, making it ideal for use cases such as chatbots, recommender systems, and code analysis tools. With its embedded architecture and flexible language support, LanceDB aims to simplify the integration of vector databases into various workflows and scenarios from small-scale data exploration to large-scale production deployments.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode