AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
6min chapter
AI Alignment & AGI Fire Alarm - Connor Leahy
Machine Learning Street Talk (MLST)
What's the Definition of Intelligence in GPT-3?
Connor: What scared me the most in the gpt-3 paper was this straight line of perplexity no i see it's a log plot but no sign of slowing down like there is ever an end inside where we can just throw in 10 times more compute and 10 times more data and we get out 10 times better whatever it is intelligence statistical association whatever that is to the other point. He says if humans do all they do is just take the generating function of the real world and regurgitate that and one output of that is language right so that's how they produce the language corpora for example. Gpt-3 is not exploring or producing anything new as people use them,
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode