Tuhin Srivastava

Tuhin Srivastava, CEO and founder of Baseten, shares insights from his journey in the AI inference space. He discusses the shift from small model serving to focusing on large model production needs, influenced by market shifts like ChatGPT. Tuhin explains the importance of dedicated deployments for custom models, along with optimizing runtime performance. He also highlights challenges in adopting new inference chips and the need for open models over closed APIs. The conversation emphasizes inference's critical role in embedding AI into applications at scale.

Tuhin Srivastava, CEO and co-founder of Baseten, specializes in scalable AI infrastructure. He shares insights on why speed is crucial for AI development, emphasizing the need for efficient code rather than no-code solutions. The conversation highlights surprising use cases for Baseten and discusses the challenges of AI training and deployment in the current landscape. Tuhin also tackles the impact of hardware shortages and the defensibility of jobs in AI, arguing that strategic investment in computing is essential for future success.

Tuhin Srivastava, founder of AI infrastructure company Baseten and a South Park Commons alum, shares impactful lessons from his journey through finance, biotech, and startups. He emphasizes the importance of a short-term focus in the rapidly evolving AI landscape, advising against scaling prematurely. Tuhin discusses the value of customer proximity, the significance of a resilient company culture that embraces change, and the benefits of long-tenured teams. He also reflects on how cricket has shaped his business mindset, advocating for quick adaptations and smart resets.

Tuhin Srivastava, Co-founder and CEO of Baseten, dives into the world of self-hosting open access models. He discusses common use cases for deploying these models while addressing the shift towards self-hosting solutions. The conversation explores the evolution of machine learning infrastructure, the challenges of model deployment, and the importance of data privacy. Tuhin also highlights innovative advancements in model hosting frameworks and the growing significance of multi-cloud strategies in AI deployment.

Tuhin Srivastava, CEO and co-founder of Baseten, shares his insights on advancing AI infrastructure for large-scale neural networks. He discusses the evolving demands on GPUs and the challenges of scalability in generative AI. The conversation highlights the trade-offs between different model types, like RAG and embedding models. Tuhin also emphasizes the cost-saving benefits and customization potential of open-source models, while addressing the rapid changes in chip architecture that shape software development.