a16z Podcast

GPT-3: What's Hype, What's Real on the Latest in AI

Jul 30, 2020

Frank Chen, an AI expert with deep insights into machine learning, delves into the excitement around GPT-3. The conversation unpacks its impressive capabilities in tasks like writing and arithmetic, exploring how its training data and architecture shape performance. Chen discusses few-shot learning's significance, the challenges startups face harnessing AI, and the potential future shifts in programming skills. They also question the implications of AI on jobs and the importance of addressing bias in technology, distinguishing reality from hype in the world of AI.

33:07

Creator website

Episode guests

Frank Chen

AI Chapters

Episode notes

Intro

3min

Exploring the Astonishing Capabilities of GPT-3

3min

Understanding GPT-3: The Architecture and Accessibility of AI

4min

Understanding Few-Shot Learning in Language Models

4min

Exploring GPT-3: Capabilities and Challenges

7min

The Future of AI and Programming Skills

12min

In this episode -- cross posted from our 16 Minutes show feed -- we cover all the buzz around GPT-3, the pre-trained machine learning model from OpenAI that’s optimized to do a variety of natural-language processing tasks.

It’s a commercial product, built on research; so what does this mean for both startups AND incumbents… and the future of “AI as a service”? And given that we’re seeing all kinds of (cherrypicked!) examples of output from OpenAI’s beta API being shared — how do we know how good it really is or isn’t? How do we know the difference between “looks like” a toy and “is” a toy when it comes to new innovations?

And where are we, really, in terms of natural language processing and progress towards artificial general intelligence? Is it intelligent, does that matter, and how do we know (if not with a Turing Test)? Finally, what are the broader questions, considerations, and implications for jobs and more? Frank Chen explains what “it” actually is and isn’t and more in conversation with host Sonal Chokshi. The two help tease apart what’s hype/ what’s real here… as is the theme of 16 Minutes.

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.