Kwasi Ankomah

Kwasi Ankomah, Lead AI Architect at SambaNova Systems, dives into the significance of AI inference and its bottlenecks. He explains how their innovative RDU chip architecture delivers over 700 tokens per second while using 90% less power. The discussion highlights the growing issue of latency with AI agents, emphasizing their increased token demands. Kwasi also explores multi-model serving to optimize costs and performance, and shares insights on the future of open-source models tailored for enterprises.