The Data Exchange with Ben Lorica cover image

An Open Source Data Framework for LLMs

The Data Exchange with Ben Lorica

00:00

Lama Index: A Workflow for Open Source Data Management

Lama index is open source. There's no weird file format being introduced in any of these steps, right? I think we do have some like kind of storage abstractions that we do provide as like objects. And so the workflow is like you ingest this data, parse this data and then put it in some sort of vector store or object store. If it's a vector store, you would also embed the data as well,. Then generate embeddings for each node.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app