AXRP - the AI X-risk Research Podcast cover image

22 - Shard Theory with Quintin Pope

AXRP - the AI X-risk Research Podcast

00:00

The Role of Reward Signals in Language Modeling

In the ancestral environment there wasn't a guy in a lab code who you could go to to get salts right yeah but there were like salt deprivations. so it's like setting up a learning configuring the learning process to learn between what the genome can quote unquote see versus like the learned understanding of the world and that lets the genome point the rat in various directions when it's relevant for behaviors that you would die when you try to learn them in the real world or that you don't have like time to learn within your lifetime sure. I see this as very similar to the sorts of things that the brain's steering Sush genonically specified behavior control system is doing within lifetime

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app