Simon Eskildsen

In this discussion, Simon Eskildsen, the co-founder and CEO of TurboPuffer, shares his insights on the challenges and advancements in AI infrastructure. Drawing from his decade at Shopify, he highlights the limitations of traditional databases for AI applications. Simon introduces the SCRAP framework, emphasizing scale, cost, recall, and performance. He delves into the rise of object storage and the complexities of vector search technology, advocating for smarter retrieval systems to enhance data efficiency and performance.

In this talk, Simon Hørup Eskildsen, an experienced software engineer and founder of Turbopuffer, shares insights from his vast experience in database scalability and object storage solutions. He dives into the challenges of building databases on object storage, discussing write-ahead logs, multi-tenancy issues, and the intricacies of handling multiple writers. Simon elaborates on trade-offs in write operations and the complexities of optimizing database read paths, offering practical strategies for performance enhancement. A must-listen for database enthusiasts!

Simon Eskildsen, Co-founder of TurboPuffer and former infrastructure builder at Shopify, dives into the fascinating world of vector databases. He discusses the transformative role of vector search in enhancing recommendation systems, alongside challenges like cost and scaling. Simon also shares insights on managing podcast episode archives using embeddings and indexing strategies. The conversation highlights the importance of observability in database performance and paints an exciting picture of future trends in vector search technology.