AI Evolution: Reasoning and Reinforcement Learning

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. The company operates a 24/7 public ride-hail service and provides over 150,000 trips each week across San Francisco, Los Angeles, Phoenix, and Austin, making mobility more accessible, sustainable, and safer for everyone.

In this week’s episode of Unsupervised Learning, we dive deep into the frontier where AI meets hardware — and there’s no better guide than Vincent Vanhoucke, Distinguished Engineer at Waymo and former Head of Robotics at DeepMind.

[0:00] Intro

[0:50] Waymo's Technological Evolution

[2:40] The Role of LLMs in Autonomous Driving

[6:02] Vincent's Journey to Waymo

[9:17] Challenges in Autonomous Driving

[11:58] Simulation and World Models

[27:44] Future Milestones and Expansion

[30:10] Broader Robotics and AI

[36:12] Future of General Robotics Models

[38:14] Hardware vs. Software Approaches in Robotics

[40:19] Challenges in Robotic Data Acquisition

[40:38] Simulation vs. Real-World Data in Robotics

[43:02] Human-Robot Interaction for Data Collection

[45:03] Advancements in Multimodal Models

[47:08] Unanswered Questions in Robotics

[52:02] Reasoning Capabilities in AI

[54:57] Future of Robotics and AI

[1:00:51] Quickfire

With your co-hosts: 

@jacobeffron 

- Partner at Redpoint, Former PM Flatiron Health 

@patrickachase 

- Partner at Redpoint, Former ML Engineer LinkedIn 

@ericabrescia 

- Former COO Github, Founder Bitnami (acq’d by VMWare) 

@jordan_segall 

- Partner at Redpoint