“My AI Model Delta Compared To Yudkowsky” by johnswentworth

Preamble: Delta vs Crux

I don’t natively think in terms of cruxes. But there's a similar concept which is more natural for me, which I’ll call a delta.

Imagine that you and I each model the world (or some part of it) as implementing some program. Very oversimplified example: if I learn that e.g. it's cloudy today, that means the “weather” variable in my program at a particular time[1] takes on the value “cloudy”. Now, suppose your program and my program are exactly the same, except that somewhere in there I think a certain parameter has value 5 and you think it has value 0.3. Even though our programs differ in only that one little spot, we might still expect very different values of lots of variables during execution - in other words, we might have very different beliefs about lots of stuff in the world.

If your model [...]

The original text contained 1 footnote which was omitted from this narration.

---

First published:
June 10th, 2024

Source:
https://www.lesswrong.com/posts/q8uNoJBgcpAe3bSBp/my-ai-model-delta-compared-to-yudkowsky

---

Narrated by TYPE III AUDIO.