The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) Trends in Reinforcement Learning with Chelsea Finn - #335
Jan 2, 2020
Chelsea Finn, Assistant Professor at Stanford University, shares her insights on advancements in reinforcement learning. She breaks down model-based approaches and the challenges of exploration in complex environments like Montezuma's Revenge. The discussion also touches on the importance of curriculum learning in robotics and the nuances of batch off-policy learning. With exciting implications for real-world applications, Chelsea highlights the evolving landscape of RL libraries and their role in bridging the gap between simulation and practical deployment.
AI Snips
Chapters
Transcript
Episode notes
RL Research Expansion
- Reinforcement learning (RL) research is expanding, with more labs exploring it.
- Researchers are moving beyond established benchmarks and considering new problem formulations.
RL Benchmarks
- Traditional RL benchmarks include video games, from simple Atari to complex ones.
- Other benchmarks involve simulated robots in physics engines, like MuJoCo, performing tasks such as locomotion.
Dexterous Manipulation and Rubik's Cube
- Two papers demonstrated dexterous manipulation with robotic hands, one using simulation and the other real-world training.
- OpenAI's Rubik's Cube solver sparked controversy due to perceived overhyping, but highlighted the difficulty of physical manipulation.