Exploring Occlusions in World Modeling and AI Training Data Approaches

11min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

The chapter delves into the topic of modeling occlusions in the physical world and questions the efficacy of two-dimensional training data approaches for reaching the same level as underlying 3D models. It discusses the limitations and weaknesses of current systems, the importance of self-supervised learning with internet-scale data, and the potential dangers of releasing AI systems like deep fakes. Additionally, it explores the evolving impact of AI on tasks in the economy, the evolution of economic systems with incentives for humans, and the anticipation for future AI advancements like GPT-5.

Sam Altman is the CEO of OpenAI, the company behind GPT-4, ChatGPT, Sora, and many other state-of-the-art AI technologies. Please support this podcast by checking out our sponsors:
– Cloaked: https://cloaked.com/lex and use code LexPod to get 25% off
– Shopify: https://shopify.com/lex to get $1 per month trial
– BetterHelp: https://betterhelp.com/lex to get 10% off
– ExpressVPN: https://expressvpn.com/lexpod to get 3 months free

Transcript: https://lexfridman.com/sam-altman-2-transcript

EPISODE LINKS:
Sam’s X: https://x.com/sama
Sam’s Blog: https://blog.samaltman.com/
OpenAI’s X: https://x.com/OpenAI
OpenAI’s Website: https://openai.com
ChatGPT Website: https://chat.openai.com/
Sora Website: https://openai.com/sora
GPT-4 Website: https://openai.com/research/gpt-4

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
YouTube Full Episodes: https://youtube.com/lexfridman
YouTube Clips: https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon: https://www.patreon.com/lexfridman
– Twitter: https://twitter.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/lexfridman
– Medium: https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(07:51) – OpenAI board saga
(25:17) – Ilya Sutskever
(31:26) – Elon Musk lawsuit
(41:18) – Sora
(51:09) – GPT-4
(1:02:18) – Memory & privacy
(1:09:22) – Q*
(1:12:58) – GPT-5
(1:16:13) – $7 trillion of compute
(1:24:22) – Google and Gemini
(1:35:26) – Leap to GPT-5
(1:39:10) – AGI
(1:57:44) – Aliens