Chat GPT is a term for a model that is trained on text data and can do amazing things, but is not very useful or easy to use.
RLHF is how humans help to make the model more useful and easier to use.
Less data is required for RLHF to work well than for the original model, and the process of incorporating human feedback is very interesting.
Sam Altman is the CEO of OpenAI, the company behind GPT-4, ChatGPT, DALL-E, Codex, and many other state-of-the-art AI technologies. Please support this podcast by checking out our sponsors:
– NetSuite: http://netsuite.com/lex to get free product tour
– SimpliSafe: https://simplisafe.com/lex
– ExpressVPN: https://expressvpn.com/lexpod to get 3 months free
OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(08:41) – GPT-4
(20:06) – Political bias
(27:07) – AI safety
(47:47) – Neural network size
(51:40) – AGI
(1:13:09) – Fear
(1:15:18) – Competition
(1:17:38) – From non-profit to capped-profit
(1:20:58) – Power
(1:26:11) – Elon Musk
(1:34:37) – Political pressure
(1:52:51) – Truth and misinformation
(2:05:13) – Microsoft
(2:09:13) – SVB bank collapse
(2:14:04) – Anthropomorphism
(2:18:07) – Future applications
(2:21:59) – Advice for young people
(2:24:37) – Meaning of life
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode