Is GPT-3 Unable to Deal With Semantics?

2min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

GPT-3 is able to do some basic math and two digit numbers. It basically fails if you take larger digit numbers, so four digit numbers and so on makes carrying mistakes. If you take larger numbers, you don't get useful results at all. And this could be an issue of the training set. There are not many examples of successful long form addition and standard human written text.

Joscha Bach is a cognitive scientist, AI researcher, and philosopher. Please support this podcast by checking out our sponsors:
– Coinbase: https://coinbase.com/lex to get $5 in free Bitcoin
– Codecademy: https://codecademy.com and use code LEX to get 15% off
– Linode: https://linode.com/lex to get $100 free credit
– NetSuite: http://netsuite.com/lex to get free product tour
– ExpressVPN: https://expressvpn.com/lexpod and use code LexPod to get 3 months free

EPISODE LINKS:
Joscha’s Twitter: https://twitter.com/Plinz
Joscha’s Website: http://bach.ai

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
YouTube Full Episodes: https://youtube.com/lexfridman
YouTube Clips: https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon: https://www.patreon.com/lexfridman
– Twitter: https://twitter.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/lexfridman
– Medium: https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(07:15) – Life is hard
(09:38) – Consciousness
(16:24) – What is life?
(26:33) – Free will
(40:38) – Simulation
(42:49) – Base layer of reality
(58:24) – Boston Dynamics
(1:06:43) – Engineering consciousness
(1:17:12) – Suffering
(1:26:06) – Postmodernism
(1:30:25) – Psychedelics
(1:43:40) – GPT-3
(1:52:22) – GPT-4
(1:58:47) – OpenAI Codex
(2:01:02) – Humans vs AI: Who is more dangerous?
(2:17:47) – Hitler
(2:22:44) – Autonomous weapon systems
(2:30:11) – Mark Zuckerberg
(2:35:47) – Love
(2:50:00) – Michael Malice and anarchism
(3:06:57) – Love
(3:11:05) – Advice for young people
(3:15:42) – Meaning of life