Open Source Startup Podcast cover image

Open Source Startup Podcast

E114: How OctoML Helps Developers Build with Llama 2 & Stable Diffusion

Nov 7, 2023
Tianqi Chen, Co-Founder and Chief Technologist of OctoML, discusses the importance of supporting multiple models, advancements in Llama and Stable Diffusion, building TVM and OctoML communities, predictions on GenAI in enterprise, and challenges in starting a MLAI company.
42:50

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • OctoML was founded to continue the development of the TVM open-source project and provide a compute platform for accelerating the deployment of AI models into production.
  • TVM offers unique technical capabilities to optimize ML models for various platforms, addressing pain points in model optimization and supporting standard and specialized variants.

Deep dives

OctoML's Origin Story and Apache TVM

OctoML was born out of the recognition of the challenges faced when deploying machine learning (ML) models on different environments. This led to the creation of Apache TVM, a project aimed at alleviating the pain points of ML product realization. The team behind OctoML started the company to continue the development of the TVM open-source project and provide a compute platform for accelerating the deployment of AI models into production.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode