5min chapter

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis cover image

BONUS: Riley Goodside on The Art of Prompting ChatGPT [The Cognitive Revolution preview]

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

CHAPTER

Large Language Models Are in Context Learners

In the original paper on GPT three, they said large language models are in context learners. And that would be referred to as doing it in zero-shot, that you're not giving it any correct examples of how to translate. But there's another interpretation that I kind of liked better, which is that pre-trained models modeling a like multiverse of fictional documents. When you prompt the model, you're sort of in a superposition of like all possible documents that might continue from this one. It has pre-trained knowledge that it's leveraging there.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode