Paranoia and Self-Preservation in AI

This is a linkpost for https://nitter.net/ESYudkowsky/status/1718654143110512741

Comp sci in 2017:

Student:  I get the feeling the compiler is just ignoring all my comments.

Teaching assistant:  You have failed to understand not just compilers but the concept of computation itself.

Comp sci in 2027:

Student:  I get the feeling the compiler is just ignoring all my comments.

TA:  That's weird.  Have you tried adding a comment at the start of the file asking the compiler to pay closer attention to the comments?

Student:  Yes.

TA:  Have you tried repeating the comments?  Just copy and paste them, so they say the same thing twice?  Sometimes the compiler listens the second time.

Source:
https://www.lesswrong.com/posts/gQyphPbaLHBMJoghD/comp-sci-in-2027-short-story-by-eliezer-yudkowsky

Narrated for LessWrong by TYPE III AUDIO.

Share feedback on this narration.

[125+ Karma Post] ✓