5min chapter

Replit AI Podcast cover image

03: The Next Generation of LLMs with Jonathan Frankle of MosaicML

Replit AI Podcast

CHAPTER

How to Match Chat GPT Across the Board

The chat model is really good, but it's not commercially usable due to the origin of the data. I think at this point, we're now seeing the result of a lot of efforts that probably started a few months ago to train llama quality models. We just need to be willing to be a little bit creative and not just train llama again for the end time. People should be willing to do weird stuff. And we can afford to do that on instruct tuning and fine tuning. It's hard to do it for base models. Oh, I completely disagree. Do it on a 300 million parameter model and work your way up. At least convince yourself that you are doing something different

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode