4min chapter

NEJM AI Grand Rounds cover image

Google’s Exploration of Large Language Models in Medicine

NEJM AI Grand Rounds

CHAPTER

The Complexity of the Large Language Model

GPT-3 training procedure is download a bunch of text from the internet and then make a model predict the next word. I think with this very simple next word prediction objective on like internet scale data what we have done is we have actually multitasked a bunch of different objectives. We're seeing all these interesting facets and phenomena emerge as we start to more optimally train these modelsScale them up understand better how to like you know train them.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode