TED Talks Daily The inside story of ChatGPT's astonishing potential | Greg Brockman
44 snips
Apr 20, 2023 
Greg Brockman, co-founder of OpenAI, dives deep into the revolutionary world of ChatGPT. He reveals the cutting-edge design principles that power this AI and showcases groundbreaking new plug-ins. Brockman discusses the training methods that blend unsupervised learning with human feedback, enhancing AI accuracy. He also tackles the controversial decision of public AI rollout versus secrecy and highlights the moral responsibilities tied to AI advancements. Expect to be fascinated by the unexpected capabilities and ethical implications of this powerful technology.
AI Snips
Chapters
Transcript
Episode notes
OpenAI's Approach
- OpenAI's success stems from confronting reality and scaling language models.
- They observed emergent semantics from syntactic processes, leading to scaled models.
GPT-3's Math Abilities
- GPT-3 can add 40-digit numbers, demonstrating learned internal circuits.
- However, it struggles with 40-digit plus 35-digit numbers, showing limited generalization.
Managing Emergent Risks
- Scaling models leads to emergent properties, both predictable and surprising.
- Incremental deployment and high-quality feedback are crucial for managing risks.