

Jitendra Malik: Building AI from the ground-up, sensorimotor before language
43 snips Aug 17, 2023
Jitendra Malik, Professor of EECS at UC Berkeley discusses building AI from the ground-up, focusing on sensorimotor capabilities before language. Topics include limitations of current AI technology, the importance of physical interaction in language models, the role of vision in robotic locomotion, progress and challenges in computer vision, the potential impact of AI in medicine and healthcare, and advice for PhD students pursuing a career in AI research.
AI Snips
Chapters
Transcript
Episode notes
Moravec's Paradox
- Human intelligence developed over millions of years, prioritizing sensorimotor skills before language.
- Current AI, while impressive in language tasks, lacks these foundational sensorimotor abilities.
Hand-Brain Co-evolution
- Fossil evidence suggests that brain development followed hand development in hominids.
- This implies that tool use and object manipulation played a crucial role in human intelligence evolution.
Grounded Language Acquisition
- Children's early vocabulary is grounded in sensorimotor experiences, connecting words to physical objects and actions.
- This grounding might be crucial for developing robust and less brittle language models.