The Importance of Human Feedback in Chatchy PT

3min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

In the movie, Hal 9000 series computer has ever been found to make an error. And I thought that was kind of a charming sort of quote from Hal to make in connection with what Chatchy PT is in that case. The interesting things about the LLM, like you said, that they are very willing to admit the error. It somehow it managed to get this above this threshold, where it really is well aligned to what we humans are interested in. Nobody saw that coming and certainly nobody who was involved in that project seems to have known it was coming.

Stephen Wolfram is a computer scientist, mathematician, theoretical physicist, and the founder of Wolfram Research, a company behind Wolfram|Alpha, Wolfram Language, and the Wolfram Physics and Metamathematics projects. Please support this podcast by checking out our sponsors:
– MasterClass: https://masterclass.com/lex to get 15% off
– BetterHelp: https://betterhelp.com/lex to get 10% off
– InsideTracker: https://insidetracker.com/lex to get 20% off

EPISODE LINKS:
Stephen’s Twitter: https://twitter.com/stephen_wolfram
Stephen’s Blog: https://writings.stephenwolfram.com
Wolfram|Alpha: https://www.wolframalpha.com
A New Kind of Science (book): https://amzn.to/30XoEun
Fundamental Theory of Physics (book): https://amzn.to/30XbAoT
Blog posts:
A 50-Year Quest: https://bit.ly/3NQbZ2P
What Is ChatGPT doing: https://bit.ly/3VOwtuz

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
YouTube Full Episodes: https://youtube.com/lexfridman
YouTube Clips: https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon: https://www.patreon.com/lexfridman
– Twitter: https://twitter.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/lexfridman
– Medium: https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(06:45) – WolframAlpha and ChatGPT
(26:26) – Computation and nature of reality
(53:18) – How ChatGPT works
(1:53:01) – Human and animal cognition
(2:06:20) – Dangers of AI
(2:14:39) – Nature of truth
(2:36:01) – Future of education
(3:12:03) – Consciousness
(3:21:02) – Second Law of Thermodynamics
(3:44:36) – Entropy
(3:57:36) – Observers in physics
(4:14:27) – Mortality