Exploring Self-Supervised Learning Techniques

Yann LeCun is the Chief AI Scientist at Meta, professor at NYU, Turing Award winner, and one of the seminal researchers in the history of machine learning. Please support this podcast by checking out our sponsors:
– Public Goods: https://publicgoods.com/lex and use code LEX to get $15 off
– Indeed: https://indeed.com/lex to get $75 credit
– ROKA: https://roka.com/ and use code LEX to get 20% off your first order
– NetSuite: http://netsuite.com/lex to get free product tour
– Magic Spoon: https://magicspoon.com/lex and use code LEX to get $5 off

EPISODE LINKS:
Yann’s Twitter: https://twitter.com/ylecun
Yann’s Facebook: https://www.facebook.com/yann.lecun
Yann’s Website: http://yann.lecun.com/
Books and resources mentioned:
Self-supervised learning (article): https://bit.ly/3Aau1DQ

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
YouTube Full Episodes: https://youtube.com/lexfridman
YouTube Clips: https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon: https://www.patreon.com/lexfridman
– Twitter: https://twitter.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/lexfridman
– Medium: https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(06:58) – Self-supervised learning
(17:17) – Vision vs language
(23:08) – Statistics
(28:55) – Three challenges of machine learning
(34:45) – Chess
(42:47) – Animals and intelligence
(52:31) – Data augmentation
(1:13:51) – Multimodal learning
(1:25:40) – Consciousness
(1:30:25) – Intrinsic vs learned ideas
(1:34:37) – Fear of death
(1:42:29) – Artificial Intelligence
(1:56:18) – Facebook AI Research
(2:12:56) – NeurIPS
(2:29:08) – Complexity
(2:37:33) – Music
(2:42:28) – Advice for young people