What Are Your Thoughts on GPT-3 and Language Models?

5min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

In the 90s, I was in New Zealand and I had an amazing professor, Ian Vitten, who realized I was bored in class and put me in his lab. He gave me the task to just cover grammatical structure in an unknown language. And he gave me the largest computer at the whole university,. It had two gigabytes of RAM, which was amazing. And I wrote everything in C with some in-memory compression to do statistics over the language. The effect that it can have on your mental wiring can be very dangerous, I think. Let's talk about AI a little bit. What are your thoughts about GPT-3 and language models trained with self-supervised

Joscha Bach is a cognitive scientist, AI researcher, and philosopher. Please support this podcast by checking out our sponsors:
– Coinbase: https://coinbase.com/lex to get $5 in free Bitcoin
– Codecademy: https://codecademy.com and use code LEX to get 15% off
– Linode: https://linode.com/lex to get $100 free credit
– NetSuite: http://netsuite.com/lex to get free product tour
– ExpressVPN: https://expressvpn.com/lexpod and use code LexPod to get 3 months free

EPISODE LINKS:
Joscha’s Twitter: https://twitter.com/Plinz
Joscha’s Website: http://bach.ai

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
YouTube Full Episodes: https://youtube.com/lexfridman
YouTube Clips: https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon: https://www.patreon.com/lexfridman
– Twitter: https://twitter.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/lexfridman
– Medium: https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(07:15) – Life is hard
(09:38) – Consciousness
(16:24) – What is life?
(26:33) – Free will
(40:38) – Simulation
(42:49) – Base layer of reality
(58:24) – Boston Dynamics
(1:06:43) – Engineering consciousness
(1:17:12) – Suffering
(1:26:06) – Postmodernism
(1:30:25) – Psychedelics
(1:43:40) – GPT-3
(1:52:22) – GPT-4
(1:58:47) – OpenAI Codex
(2:01:02) – Humans vs AI: Who is more dangerous?
(2:17:47) – Hitler
(2:22:44) – Autonomous weapon systems
(2:30:11) – Mark Zuckerberg
(2:35:47) – Love
(2:50:00) – Michael Malice and anarchism
(3:06:57) – Love
(3:11:05) – Advice for young people
(3:15:42) – Meaning of life