Entrepreneurial Thought Leaders (ETL) cover image

Entrepreneurial Thought Leaders (ETL)

Ilya Sutskever (OpenAI) - Inside OpenAI

Apr 26, 2023
50:45

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • Deep learning will continue to make progress in the next 5 to 10 years, with improvements in many layers of the stack and specialized training for specific domains.
  • OpenAI acknowledges the desire for access to their technologies and takes an intermediate approach between open and closed sourcing, encouraging collaborative research.

Deep dives

Iliya Sootzgever: Co-founder and Chief Scientist of Open AI

Iliya Sootzgever is the co-founder and chief scientist of Open AI, a company that aims to build artificial general intelligence. He is known for his work on the large language model GPT-3 and its public-facing product, Chat GPT. Sootzgever's background includes a Bachelor's degree in mathematics from the University of Toronto and a Master's and PhD in computer science. He has made significant contributions to the field of deep learning, including being the main impetus behind AlexNet, a convolutional neural network that set off the deep learning revolution. Sootzgever's work on Chat GPT has had a profound impact and its release in November 2022 generated excitement as well as societal concerns. He believes that the human brain serves as the best example of intelligence and has worked on developing large language models to mimic human understanding and prediction. Sootzgever acknowledges that current AI systems are still far from matching human capabilities, but the potential for AI to surpass human learning in the future is not inconceivable. He views consciousness as a matter of degree rather than a binary distinction and suggests that an experiment could be conducted to determine if an AI system can articulate awareness without being explicitly trained on consciousness. Open AI's mission is to ensure that artificial general intelligence benefits all of humanity, and they are open to exploring sensible government regulations to ensure responsible development and deployment of AI technologies. Sootzgever acknowledges the importance of technical progress in deep learning and expects the field to continue evolving. While there may be limitations to scaling large language models, he believes that progress will come from various dimensions of deep learning and that specialized training for specific domains will be beneficial once a robust understanding of tasks is achieved.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode