The landscape of AI is becoming increasingly consolidated, with high capital expenditure required for training large language models, limiting this capability to a few organizations. However, the emergence of frontier-level open source models is noteworthy, as they offer flexibility and the ability to deeply experiment with AI technologies. This new wave of open source AI allows developers to adapt and manipulate models in a way that's not possible with API-accessible models. Technologies such as 'task vectors' enable real-time modifications of model weights, facilitating innovative applications. As smaller models gain efficiency and decrease in cost, their utility is being validated, emphasizing user control and adaptability. This trend towards smaller, locally-run models is particularly advantageous for edge device deployment, where network latency can be a concern. The duality of large and small models in the AI ecosystem presents exciting possibilities for hobby projects and practical applications alike.
Chroma is an open-source AI application database.
Anton Troynikov is a Founder at Chroma. He has a background in computer vision and previously worked at Meta. In this episode Anton speaks with Sean Falconer about Chroma, and the goal of building the memory and storage subsystem for the new computing primitive that AI models represent.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer.
Please click here to see the transcript of this episode.
The post Chroma’s Vector Database with Anton Troynikov appeared first on Software Engineering Daily.