This Week in Startups

Exploring AI's Pace of Evolution, AGI's Future, and Data Dominance with Adept CEO David Luan | E1855

18 snips
Nov 29, 2023
David Luan, CEO of Adept AI and former OpenAI and Google Brain expert, dives into the exciting world of AI evolution. He shares insights on the rapid advancements in language models like DALL-E and the future of Artificial General Intelligence. Luan showcases Adept's workflow automation, highlighting how AI can revolutionize workplace efficiency. He also discusses the importance of quality data and how custom AI agents can transform business processes, making a strong case for AI's role in enhancing productivity and decision-making.
Ask episode
AI Snips
Chapters
Transcript
Episode notes
ANECDOTE

David Luan's OpenAI Journey

  • David Luan joined OpenAI when it was around 35 people and saw it grow to about 135.
  • His team worked on foundational research, including GPT-2, CLIP, DALL-E, and supercomputing efforts.
INSIGHT

GPT-2's Innovation

  • GPT-2's key innovation was framing all natural language understanding tasks as text generation.
  • This approach worked because of the unique dataset it was trained on, curated from Reddit links with at least three upvotes.
ANECDOTE

GPT-2 and Reddit

  • Common Crawl data, initially meant for search engines, proved to be mostly unusable due to its low quality.
  • Instead, GPT-2's dataset leveraged Reddit's upvote system to filter for higher-quality web pages linked in posts.
Get the Snipd Podcast app to discover more snips from this episode
Get the app