Gradient Dissent: Conversations on AI cover image

Jeremy Howard — The Simple but Profound Insight Behind Diffusion

Gradient Dissent: Conversations on AI

CHAPTER

Using Diffusion to Generate Text Models

The way we currently do generative text models, again, it's kind of a happy accident. There was this kind of discovery almost with GPT-3 that when you take this and you scale it far enough, it actually starts generating reasonable sounding text. But the text is not necessarily correct. In fact, it's very often wildly incorrect. So yeah, these things are already starting to exist. They haven't had as much resources put into them yet, so they're still not that great. This is not just images at all. It will be used in medicine, it'll be used in copywriting.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner