Weaviate Podcast Box AI with Ben Kus and Bob van Luijt
5 snips
May 7, 2025 
Ben Kus, CTO of Box, delves into the complexities of the company's three-layer infrastructure: managing millions of interactions, navigating multi-tenant security challenges, and ensuring AI adheres to intricate content permissions. He discusses the impact of vector embeddings on file sizes and emphasizes the continued relevance of RAG despite advancements in context windows. The conversation also highlights Box's development of AI agents aimed at streamlining cumbersome enterprise processes, creating a path to improved productivity in the workplace.
AI Snips
Chapters
Transcript
Episode notes
Box's Massive Data Scale
- Box manages exabyte scale data with trillions of files and millions of interactions per second.
- Handling this massive unstructured content growth requires robust distributed infrastructure and engineering efforts.
Multi-Tenant Sharing Challenges
- Box faces a unique multi-tenant challenge: content is shared across company boundaries.
- AI must respect these complex permission rules to ensure secure content access.
Multi-Cloud and AI Preferences
- Enterprises prefer hyperscaler clouds, driving Box's multi-cloud strategy.
- AI model choice and quality vary, so Box supports multiple models respecting security and permission needs.