Machine Learning Street Talk (MLST) #031 WE GOT ACCESS TO GPT-3! (With Gary Marcus, Walid Saba and Connor Leahy)
21 snips
Nov 28, 2020 
This conversation features Gary Marcus, a psychology and neuroscience professor, known for critiquing deep learning, alongside Waleed Sabah, an expert in natural language understanding, and Connor Leahy, a proponent of large language models. They dive into GPT-3's strengths and weaknesses, the philosophical implications of AI creativity, and the importance of integrating reasoning with pattern recognition. The dialogue also critiques AI's limitations in understanding language and explores future possibilities for achieving true artificial general intelligence.
AI Snips
Chapters
Books
Transcript
Episode notes
The Dog Interviewer
- Someone recounted a humorous LinkedIn post about a job interview.
- The interviewee missed the first interview to help a dog, only to find the dog was the interviewer.
GPT-3: A Distraction, Not a Solution
- Gary Marcus believes GPT-3 is a distraction in the pursuit of trustworthy AI.
- It relies on text correlations, not true understanding, making it unreliable.
GPT-3 Hype
- Media outlets hype GPT-3, cherry-picking impressive examples.
- This creates an inaccurate perception of GPT-3's capabilities.
