
An Open Source Data Framework for LLMs
The Data Exchange with Ben Lorica
00:00
Lama Index: A Workflow for Open Source Data Management
Lama index is open source. There's no weird file format being introduced in any of these steps, right? I think we do have some like kind of storage abstractions that we do provide as like objects. And so the workflow is like you ingest this data, parse this data and then put it in some sort of vector store or object store. If it's a vector store, you would also embed the data as well,. Then generate embeddings for each node.
Transcript
Play full episode