
23 - Mechanistic Anomaly Detection with Mark Xu
AXRP - the AI X-risk Research Podcast
The Inevitable Property of Maximum Entropy
So is the idea that you have this like intermediate thing in your circuit and you have to be maximum entropy also over this intermediate thing. Yeah, that's right. And I think I think of this as a special case of a more general phenomena where like, there's this like computation that you're doing throughout the circuit. So even though you didn't really care about the intermediate thing, like it didn't play any role of interest in anything else, because you're like being maximum entropy over that,. Like you've got to like mess around with the distributions over other variables.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.