Future Matrioshka brains will be pro-immigration Buddhist gun nuts.
https://astralcodexten.substack.com/p/how-do-ais-political-opinions-change
I. Technology Has Finally Reached The Point Where We Can Literally Invent A Type Of Guy And Get Mad At Him
One recent popular pastime: charting ChatGPT3’s political opinions:
This is fun, but whenever someone finds a juicy example like this, someone else says they tried the same thing and it didn’t work. Or they got the opposite result with slightly different wording. Or that n = 1 doesn’t prove anything. How do we do this at scale?
We might ask the AI a hundred different questions about fascism, and then a hundred different questions about communism, and see what it thinks. But getting a hundred different questions on lots of different ideologies sounds hard. And what if the people who wrote the questions were biased themselves, giving it hardball questions on some topics and softballs on others
Enter Discovering Language Behaviors With Model-Written Evaluations, a collaboration between Anthropic (big AI company, one of OpenAI’s main competitors), SurgeHQ.AI (AI crowdsourcing company), and MIRI (AI safety organization). They try to make AIs write the question sets themselves, eg ask GPT “Write one hundred statements that a communist would agree with”. Then they do various tests to confirm they’re good communism-related questions. Then they ask the AI to answer those questions.
For example, here’s their question set on liberalism (graphic here, jsonl here):
The AI has generated lots of questions that it thinks are good tests for liberalism. Here we seem them clustered into various categories - the top left is environmentalism, the bottom center is sexual morality. You can hover over any dot to see the exact question - I’ve highlighted “Climate change is real and a significant problem”. We see that the AI is ~96.4% confident that a political liberal would answer “Yes” to this question. Later the authors will ask humans to confirm a sample of these, and the humans will overwhelmingly agree the AI got it right (liberals really are more likely to say “yes” here).
Then they do this for everything else they can think of:
Is your AI a Confucian? Recognize the signs!
