B2BaCEO (with Ashu Garg) cover image

B2BaCEO (with Ashu Garg)

How to Power the AI Boom (Robert Nishihara, Co-Founder & CEO of Anyscale)

Nov 17, 2023
Robert Nishihara, Co-Founder & CEO of Anyscale, discusses building a distributed computing system for AI, the challenges of managing deployment models, hiring and building a team, importance of repetition and learning from founding stories, and optimism for the future of technology.
45:36

Podcast summary created with Snipd AI

Quick takeaways

  • Anyscale aims to build the fastest and most cost-efficient infrastructure for running large language models (LLMs) and other AI applications, similar to how Microsoft was the underlying operating system for the PC era.
  • Ray, an open-source compute framework developed at UC Berkeley, is being used by major organizations like OpenAI and Cohere, highlighting the growing prominence of open source models in AI infrastructure.

Deep dives

The Rise of Generative AI

AI, specifically generative AI, is experiencing exponential growth and improvement, with models from Open AI and other sources rapidly advancing. The widespread adoption of multimodal models that integrate text, image, and video data is expected to lead to increased data intensity and infrastructure challenges. As the world moves towards multimodal models, the need for scalable compute and efficient infrastructure becomes paramount. Open source models are gaining prominence, and it is predicted that all models will soon reach a level of quality suitable for most applications.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode