Inference by Turing Post

When Will We Give AI True Memory? A conversation with Edo Liberty, CEO and founder @ Pinecone

May 19, 2025
Edo Liberty, founder and CEO of Pinecone, and former Amazon scientist, dives into the fascinating world of AI memory. He discusses the critical distinction between cognitive skills and knowledge, and the limitations of current retrieval-augmented generation models. Edo predicts that within two years, handling massive volumes of documents will be standard for AI. He emphasizes the importance of storage over compute power and raises important questions about the societal implications of accurate knowledge representation in AI. His insights reveal a world where AI could truly remember what matters.
Ask episode
AI Snips
Chapters
Books
Transcript
Episode notes
INSIGHT

Cognitive Skills Versus Knowledge

  • Current LLMs excel at cognitive skills but lack the full pipeline to be knowledgeable agents.
  • True memory requires ingesting, organizing, indexing, and real-time access to information coherently.
ADVICE

Improve The Whole Knowledge Pipeline

  • Build end-to-end systems that improve all parts of the knowledge pipeline together.
  • Invest in ingestion, retrieval, post-processing, and orchestration rather than only models.
INSIGHT

Storage And Retrieval Are Key

  • Scaling knowledge is a storage and architecture problem as much as a modeling one.
  • You must combine dense and sparse retrieval and train embeddings for retrieval-aware search.
Get the Snipd Podcast app to discover more snips from this episode
Get the app