Latent Space: The AI Engineer Podcast

Why Google failed to make GPT-3 + why Multimodal Agents are the path to AGI — with David Luan of Adept

124 snips
Mar 22, 2024
David Luan, Co-founder and CEO of Adept, previously led efforts at Google and OpenAI. He shares fascinating insights about why Google lagged in creating GPT-3 despite their early lead in AI research. Luan discusses the shift from reinforcement learning to transformer models, emphasizing the significance of multimodal agents for achieving artificial general intelligence. He also highlights how Adept's AI agents aim to revolutionize productivity, seamlessly integrating into workflows to enhance human capabilities in software tasks.
Ask episode
AI Snips
Chapters
Transcript
Episode notes
ANECDOTE

Early Leadership at OpenAI

  • David Luan joined OpenAI early and quickly took on leadership.
  • On his second or third day, he was asked to manage directs while Greg and Ilya focused on individual contributor work.
INSIGHT

OpenAI's Big Swing Approach

  • OpenAI differentiated itself by focusing on ambitious goals and solving them at all costs.
  • This approach prioritized impactful outcomes over traditional research metrics like novelty.
INSIGHT

Why Google Couldn't Make GPT-3

  • Google's organizational structure hindered its ability to compete with OpenAI on large language models (LLMs).
  • Despite having resources and talent, Google struggled to focus resources on scaling LLMs like GPT-3.
Get the Snipd Podcast app to discover more snips from this episode
Get the app