3min chapter

Machine Learning Street Talk (MLST) cover image

PERPLEXITY AI - The future of search.

Machine Learning Street Talk (MLST)

CHAPTER

The Future of Language Models

The future of language models and also do you remember the lacoon recently put that slide out where he said there these exponentially diverging trajectories and auto-aggressive models are doomed I mean what do you think about that yeah. He's actually missing those that number one as we pre-trained these models on so much data like trillions of tokens the amount of data efficiency you gain for the behavior cloning step is this immense. You can generate infinite data if you have a good reward model or and topics new constitutionally I stuff that samples you know different principles and ask like not just one scalar reward but several scalars that you can create on the fly.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode