AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
4min chapter
#65 – Katja Grace on Slowing Down AI and Whether the X-Risk Case Holds Up
Hear This Idea
The Problem With AI Learning to Understand Our Values
The challenge is getting these systems to share those values or just care about those things in some robust sense. It seems like thinking of this as it's surviving or not doesn't actually make sense unless it's at the very end of training. How does it come to know which weight changes are good? It has to understand the working of its own mind or something. Also, even if it can, it's not immediately obvious to me that the one where it does the thing you wanted it to do is better for it.
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode