6min chapter

No Priors: Artificial Intelligence | Technology | Startups cover image

The bot Cicero can collaborate, scheme and build trust with humans. What does this mean for the next frontier of AI? With Noam Brown, Research Scientist at Meta

No Priors: Artificial Intelligence | Technology | Startups

CHAPTER

Is Scaling the Bottleneck?

Alad: It's not clear that data really is the bottleneck on performance here. So I think the bottleneck is going to be scaling. You can spend $50 million training this model ahead of time, like pre-training this model. And when it comes to actual inference, it costs like a penny. Sometimes if people want to give a better a better answer, they'll sit there and they'll think a bit. That leads to a better outcome. Alad: We had a relatively good data set of about 50,000 games with dialogue. Can you talk about what we did in terms of self play and the data that actually was involved?

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode