Unsupervised Learning cover image

Unsupervised Learning

Ep 50: Fireworks CEO Lin Qiao on Why There Won’t be a Single Model, Will Hyperscalers Win Inference & AI Use-cases with PMF

Dec 16, 2024
Lin Qiao, co-founder and CEO of Fireworks.ai and former PyTorch leader at Meta, shares her insights on the future of AI. She discusses the shift toward compound AI systems and the evolving landscape of inference models. Lin highlights the importance of customization, human involvement in AI processes, and the benefits of running smaller models locally for cost and privacy. She also explores the competitive dynamics between in-house and open-source models, and the need for effective evaluation strategies as AI continues to transform industries.
55:49

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • The future of AI will pivot towards compound systems that integrate specialized small expert models for diverse tasks rather than relying on single-model architectures.
  • Addressing the challenges of AI infrastructure necessitates a comprehensive approach to model assembly, focusing on reducing inconsistencies and hallucinations in real-world applications.

Deep dives

Evolving Open Source Ecosystem

The open source ecosystem is transforming significantly, with the rise of compound AI systems emerging as a focal point. Lin emphasizes that the future requires a shift from single model architectures to complex systems integrating multiple experts across varying modalities. This evolution allows developers to harness the expertise of specialized models tailored for distinct tasks, enabling efficient problem-solving capabilities. The emphasis on open source allows for greater customization and adaptability, particularly as developers seek to combine different models to meet their unique challenges.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode