Eye On A.I.

#159 Peter Chen: Building the AI-Driven Future of Robotics

Dec 3, 2023

51:29

Snipd AI

Peter Chen, the co-founder and CEO of Covariant, discusses the AI-driven future of robotics. Topics include world models, generative AI, building role models for agents, training with additional data sources, foundation model architecture, and the impact of AI on industries. Oracle Cloud Infrastructure is introduced as a solution for training AI models at a faster speed and lower cost.

AI Summary

Highlights

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

Building a universal foundation model for robotics that can operate different kinds of industrial robots across three continents is crucial for solving robotic manipulation problems across multiple industries.

World models play a crucial role in predicting the outcomes of actions and generalizing across various robotic applications, enabling robots to understand the environment, anticipate consequences, and make informed decisions.

Deep dives

Building a Universal Foundation Model for Robotics

Peter Chen, co-founder and CEO of Co-variant, discusses the importance of building a universal foundation model for robotics that can operate different kinds of industrial robots across three continents. This foundation model leverages data from various robot experiences to better understand physics and control robots in the physical world. It allows the AI to anticipate the consequences of its actions and adapt to different robot hardware bodies and environments. The goal is to create a foundation model that can solve robotic manipulation problems across multiple industries.

Covariant’s Conviction on Foundation Model for Robotics

01:42

Robotic Foundation Model Contains Physical Principles

01:27

Importance of Speed and Cost of Inference for Robotics

00:54

Embrace the Unknown in Robotics Progress

01:21

Introduction

3min

The Role of World Models in Robotics

7min

Discussing the Relationship Between Generative AI Course and Transformer Algorithm

2min

Building Role Models for AI Agents in Robotics

8min

Training AI-driven Robotics: The Role of Video and Additional Data Sources

7min

Foundation Model Architecture and Representations

22min

The Next Generation of the Cloud: Oracle Cloud Infrastructure for AI

2min

This episode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI models faster and at half the cost. Be ahead like Uber and Cohere.

If you want to do more and spend less like Uber, 8x8, and Databricks Mosaic - take a free test drive of OCI at https://oracle.com/eyeonai

In episode #159 of Eye on AI, Craig Smith sits down with Peter Chen, the co-founder and CEO of Covariant, in a deep dive into the world of AI-driven robotics.

Peter shares his journey from his early days in China to his pivotal role in shaping the future of AI at Covariant. He discusses the philosophies that guided his work at OpenAI and how these have influenced Covariant's mission in robotics.

This episode unveils how Covariant is harnessing AI to build foundational models for robotics, discussing the intersection of reinforcement learning, generative models, and the broader implications for the field. Peter elaborates on the challenges and breakthroughs in developing AI agents that can operate in dynamic, real-world environments, providing insights into the future of robotics and AI integration.

Join us for this insightful conversation, where Peter Chen maps out the evolving landscape of AI in robotics, shedding light on how Covariant is pushing the boundaries of what's possible.

Stay updated:

Craig Smith's Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Preview and Introduction

(03:10) Peter Chen Journey in AI

(09:53) The Evolution of Generative AI and Transformer Models

(12:21) The Concept of World Models in AI

(14:03) Building Robust Role Models in AI

(20:48) Training AI: From Video Analysis to Real-World Interaction

(23:10) The Three Pillars of Building a Robotic Foundation Model

(27:36) Architectural Insights of Covariant's Foundation Model

(33:20) Adapting AI Models to Diverse Hardware

(35:01) The Future of Robotics: Progress and Potential

(38:55) Real-World Application and Future of AI-Controlled Robots

(42:11) Envisioning the Future of Automated Warehouses

(45:51) The Evolution of Robotics: Current Trends and Future Prospects

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Eye On A.I.

#159 Peter Chen: Building the AI-Driven Future of Robotics

Podcast summary created with Snipd AI

Quick takeaways

Deep dives

Building a Universal Foundation Model for Robotics

The Role of World Models in Robotics

The Data Recipe for Robotic Foundation Models

Advancements in Robotics and the Path Forward

Covariant’s Conviction on Foundation Model for Robotics

Robotic Foundation Model Contains Physical Principles

Importance of Speed and Cost of Inference for Robotics

Embrace the Unknown in Robotics Progress

Get the Snipd
podcast app

AI-powered
podcast player

Discover
highlights

Save any
moment

Share
& Export

AI-powered
podcast player

Discover
highlights

Eye On A.I.

#159 Peter Chen: Building the AI-Driven Future of Robotics

Podcast summary created with Snipd AI

Quick takeaways

Deep dives

Building a Universal Foundation Model for Robotics

The Role of World Models in Robotics

The Data Recipe for Robotic Foundation Models

Advancements in Robotics and the Path Forward

Covariant’s Conviction on Foundation Model for Robotics

Robotic Foundation Model Contains Physical Principles

Importance of Speed and Cost of Inference for Robotics

Embrace the Unknown in Robotics Progress

Get the Snipdpodcast app

AI-poweredpodcast player

Discoverhighlights

Save anymoment

Share& Export

AI-poweredpodcast player

Discoverhighlights

Get the Snipd
podcast app

AI-powered
podcast player

Discover
highlights

Save any
moment

Share
& Export

AI-powered
podcast player

Discover
highlights