John Schulman, Cofounder of OpenAI, discusses post-training advancements enabling GPT-4o, AI coworkers in 1-2 years, reasoning traces, long horizon RL, & multimodal agents. Plan for AGI in 2025, keeping humans in the loop, advice for RL researchers, & challenges in AI research.

Greg Brockman, a prominent figure at OpenAI, and John Schulman, who recently transitioned to Anthropic, join Paul Roetzer, creator of JobsGPT. They dive into OpenAI's enigmatic project 'Strawberry' and the recent leadership shifts. The trio explores how JobsGPT assesses AI's impact on job markets. They also delve into the risks associated with the new GPT-4o model and discuss the latest controversies, from lawsuits facing OpenAI to innovations in robotics like the Figure 02 Robot and AI-generated content detection efforts.

John Schulman, co-founder OpenAI, discusses with host Pieter Abbeel the invention, capabilities, and limitations of ChatGPT. Subscribe to the Robot Brains Podcast today | Visit therobotbrains.ai and follow us on YouTube at TheRobotBrainsPodcast and Twitter at @pabbeel. Hosted on Acast. See acast.com/privacy for more information.

John Schulman is a cofounder of OpenAI, and currently a researcher and engineer at OpenAI.Featured ReferencesWebGPT: Browser-assisted question-answering with human feedbackReiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, Xu Jiang, Karl Cobbe, Tyna Eloundou, Gretchen Krueger, Kevin Button, Matthew Knight, Benjamin Chess, John SchulmanTraining language models to follow instructions with human feedbackLong Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul Christiano, Jan Leike, Ryan LoweAdditional ReferencesOur approach to alignment research, OpenAI 2022Training Verifiers to Solve Math Word Problems, Cobbe et al 2021UC Berkeley Deep RL Bootcamp Lecture 6: Nuts and Bolts of Deep RL Experimentation, John Schulman 2017Proximal Policy Optimization Algorithms, Schulman 2017Optimizing Expectations: From Deep Reinforcement Learning to Stochastic Computation Graphs, Schulman 2016

Join OpenAI co-founder John Schulman as he navigates his transition to the rival company Anthropic. Schulman shares insights on the AI sector's leadership shake-up and the ensuing community reactions. The conversation dives into the challenges and ethical implications surrounding AI, personal legal battles, and evolving software practices. Tune in as they also discuss innovative projects like supermarket price tracking and corporate relocations, shedding light on the changing tech landscape.