Neural Networks and Human Cognition

Jim Keller is a legendary microprocessor engineer, previously at AMD, Apple, Tesla, Intel, and now Tenstorrent. Please support this podcast by checking out our sponsors:
– Athletic Greens: https://athleticgreens.com/lex and use code LEX to get 1 month of fish oil
– Brooklinen: https://brooklinen.com and use code LEX to get $25 off + free shipping
– ExpressVPN: https://expressvpn.com/lexpod and use code LexPod to get 3 months free
– Belcampo: https://belcampo.com/lex and use code LEX to get 20% off first order

EPISODE LINKS:
Jim’s Twitter: https://twitter.com/jimkxa
Jim’s Wiki: https://en.wikipedia.org/wiki/Jim_Keller_(engineer)
Tenstorrent: https://www.tenstorrent.com/

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
YouTube Full Episodes: https://youtube.com/lexfridman
YouTube Clips: https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon: https://www.patreon.com/lexfridman
– Twitter: https://twitter.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/LexFridmanPage
– Medium: https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(07:02) – Good design is both science and engineering
(13:03) – Javascript
(17:09) – RISC vs CISC
(21:09) – What makes a great processor?
(22:38) – Intel vs ARM
(24:27) – Steve Jobs and Apple
(27:05) – Elon Musk and Steve Jobs
(32:50) – Father
(36:33) – Perfection
(42:48) – Modular design
(48:22) – Moore’s law
(55:20) – Hardware for deep learning
(1:02:14) – Making neural networks fast at scale
(1:09:51) – Andrej Karpathy and Chris Lattner
(1:14:05) – How GPUs work
(1:18:12) – Tesla Autopilot, NVIDIA, and Mobileye
(1:22:52) – Andrej Karpathy and Software 2.0
(1:29:13) – Tesla Dojo
(1:31:49) – Neural networks will understand physics better than humans
(1:34:02) – Re-engineering the human brain
(1:38:56) – Infinite fun and the Culture Series by Iain Banks
(1:40:50) – Neuralink
(1:46:13) – Dreams
(1:50:06) – Ideas
(2:00:19) – Aliens
(2:05:16) – Jordan Peterson
(2:10:13) – Viruses
(2:13:22) – WallStreetBets and Robinhood
(2:21:25) – Advice for young people
(2:23:15) – Human condition
(2:25:43) – Fear is a cage
(2:30:34) – Love
(2:36:57) – Regrets