5min chapter

Replit AI Podcast cover image

03: The Next Generation of LLMs with Jonathan Frankle of MosaicML

Replit AI Podcast

CHAPTER

The 3B Model: A Sweet Spot for Software Development

The 3B model is portable enough to run on a computer from 10 years ago. It's really fun to see just the community hacking and playing with it, so that was a consideration for us. I'm kind of optimistic that without too much trouble, we may be able to get a model that is weird shape for H 100s and is easily adaptable for CPUs. There's so much more we can do. And I'm really excited about what our next steps are.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode