5min chapter

"Age of Miracles" cover image

Anton Teaches Packy AI | E1

"Age of Miracles"

CHAPTER

Is GPT 3 Parallelisable?

Corma Corma: GPT three is a great general model for like human texts, but it's not particularly good in particular. So if you have something like GPT to test, then that shows up as an example of how the algorithm can work with different text types and languages. He says there are lots of ways to train transformers including using noise parameters or even just randomly deleting words at random. The most interesting thing he has noticed so far about this system is its ability to structure sentences very similar to what humans would say they're doing.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode