John Schulman

Join John Schulman, OpenAI co-founder and ChatGPT architect, as he dives deep into the future of AI. He discusses how post-training enhances model capabilities and the roadmap to achieving AGI by 2027. Schulman highlights the importance of reasoning in AI, the evolution of language models, and the delicate balance between human oversight and automation. He also shares insights on the role of memory in AI systems and how new training methods can reshape interactions, making AI assistants more proactive and effective.

John Schulman, co-founder OpenAI, discusses with host Pieter Abbeel the invention, capabilities, and limitations of ChatGPT. Subscribe to the Robot Brains Podcast today | Visit therobotbrains.ai and follow us on YouTube at TheRobotBrainsPodcast and Twitter at @pabbeel. Hosted on Acast. See acast.com/privacy for more information.

John Schulman is a cofounder of OpenAI, and currently a researcher and engineer at OpenAI.Featured ReferencesWebGPT: Browser-assisted question-answering with human feedbackReiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, Xu Jiang, Karl Cobbe, Tyna Eloundou, Gretchen Krueger, Kevin Button, Matthew Knight, Benjamin Chess, John SchulmanTraining language models to follow instructions with human feedbackLong Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, Ryan LoweAdditional ReferencesOur approach to alignment research, OpenAI 2022Training Verifiers to Solve Math Word Problems, Cobbe et al 2021UC Berkeley Deep RL Bootcamp Lecture 6: Nuts and Bolts of Deep RL Experimentation, John Schulman 2017Proximal Policy Optimization Algorithms, Schulman 2017Optimizing Expectations: From Deep Reinforcement Learning to Stochastic Computation Graphs, Schulman 2016

Join OpenAI co-founder John Schulman as he navigates his transition to the rival company Anthropic. Schulman shares insights on the AI sector's leadership shake-up and the ensuing community reactions. The conversation dives into the challenges and ethical implications surrounding AI, personal legal battles, and evolving software practices. Tune in as they also discuss innovative projects like supermarket price tracking and corporate relocations, shedding light on the changing tech landscape.

John Schulman, a Research Scientist and co-founder of OpenAI, co-leads efforts in reinforcement learning, focusing on algorithms that learn through trial and error. He shares insights on the evolution from TRPO to PPO and the intricate role of stochastic computation graphs. Schulman discusses the challenges of generalization in RL and how OpenAI Five leveraged these techniques for Dota victories. The conversation also touches on navigating AI alignment challenges and the significance of integrating human intuition into machine learning.