The Gradient: Perspectives on AI cover image

The Gradient: Perspectives on AI

Eric Jang on Robots Learning at Google and Generalization via Language

Jan 8, 2022
01:33:19

In episode 20 of The Gradient Podcast, we talk to Eric Jang, a research scientist on the Robotics team at Google.

Eric is a research scientist on the Robotics team at Google. His research focuses on answering whether big data and small algorithms can yield unprecedented capabilities in the domain of robotics, just like the computer vision, translation, and speech revolutions before it. Specifically, he focuses on robotic manipulation and self-supervised robotic learning.

Sections:

(00:00) Intro(00:50) Start in AI / Research(03:58) Joining Google Robotics(10:08) End to End Learning of Semantic Grasping(19:11) Off Policy RL for Robotic Grasping(29:33) Grasp2Vec(40:50) Watch, Try, Learn Meta-Learning from Demonstrations and Rewards(50:12) BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning(59:41) Just Ask for Generalization(01:09:02) Data for Robotics(01:22:10) To Understand Language is to Understand Generalization (01:32:38) Outro

Papers discussed:

* Grasp2Vec: Learning Object Representations from Self-Supervised Grasping

* End-to-End Learning of Semantic Grasping

* Deep reinforcement learning for vision-based robotic grasping: A simulated comparative evaluation of off-policy methods

* Watch, Try, Learn Meta-Learning from Demonstrations and Rewards

* BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning

* Just Ask for Generalization

* To Understand Language is to Understand Generalization

* Robots Must Be Ephemeralized



Get full access to The Gradient at thegradientpub.substack.com/subscribe

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode