Latent Space: The AI Engineer Podcast

Cloud Intelligence at the speed of 5000 tok/s - with Ce Zhang and Vipul Ved Prakash of Together AI

13 snips
Feb 8, 2024
In this engaging discussion, Ce Zhang, Co-founder and CTO of Together AI, and Vipul Ved Prakash, Co-founder and CEO, share their insights on the evolution of open and independent AI systems. They highlight the balance between open-source contributions and proprietary innovations, stressing the importance of diverse data sources for training models. From optimization strategies for GPU cloud performance to their innovative AI platform upgrades, they delve into crucial advancements like federated learning and hybrid model architectures, shaping the future of AI.
Ask episode
AI Snips
Chapters
Books
Transcript
Episode notes
ANECDOTE

Vipul's Razor

  • Vipul Ved Prakash's first creation was an open-source collaborative spam filter called Vipul's Razor.
  • His first company, Cloudmark, built commercial products around open source.
INSIGHT

Data Movement in ML Systems

  • Machine learning systems have consistently focused on data movement across stacks.
  • This applies to distributed computing, flash attention, and various memory hierarchies.
INSIGHT

RedPajama's Purpose

  • RedPajama, inspired by LLaMA 1, aimed to reproduce its data recipe for community learning and improvement.
  • This led to projects like Slim Pajama, which improved data deduplication.
Get the Snipd Podcast app to discover more snips from this episode
Get the app