AXRP - the AI X-risk Research Podcast cover image

23 - Mechanistic Anomaly Detection with Mark Xu

AXRP - the AI X-risk Research Podcast

CHAPTER

The Inevitable Property of Maximum Entropy

So is the idea that you have this like intermediate thing in your circuit and you have to be maximum entropy also over this intermediate thing. Yeah, that's right. And I think I think of this as a special case of a more general phenomena where like, there's this like computation that you're doing throughout the circuit. So even though you didn't really care about the intermediate thing, like it didn't play any role of interest in anything else, because you're like being maximum entropy over that,. Like you've got to like mess around with the distributions over other variables.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner