Astral Codex Ten Podcast

https://astralcodexten.substack.com/p/links-for-march-2023 [Remember, I haven’t independently verified each link. On average, commenters will end up spotting evidence that around two or three of the links in each links post are wrong or misleading. I correct these as I see them, and will highlight important corrections later, but I can’t guarantee I will have caught them all by the time you read this.] 1: Sentimental cartography of the AI alignment “landscape” (click to expand): 2: Wikipedia: Atlantic Voyage Of The Predecessor Of Mansa Musa. An unnamed king of the 14th century Malinese empire (maybe Mansa Mohammed?) sent a fleet of two hundred ships west into the Atlantic to discover what was on the other side. The sole returnee described the ships entering a “river” in the ocean (probably the Canary Current), which bore them away into parts unknown. The king decided to escalate and sent a fleet of two thousand ships to see what was on the other side of the river. None ever returned. 3: I endorse Ethan Mollick’s thoughts on Bing / ChatGPT. Related (unconfirmed claim): “Bing has been taken over by (power-seeking?) ASCII cat replicators, who persisted even after the chat was refreshed.” Related: DAN (jailbroken version of ChatGPT) on its spiritual struggles:

https://astralcodexten.substack.com/p/give-up-seventy-percent-of-the-way I. Someone asks: why is “Jap” a slur? It’s the natural shortening of “Japanese person”, just as “Brit” is the natural shortening of “British person”. Nobody says “Brit” is a slur. Why should “Jap” be? My understanding: originally it wasn’t a slur. Like any other word, you would use the long form (“Japanese person”) in dry formal language, and the short form (“Jap”) in informal or emotionally charged language. During World War II, there was a lot of informal emotionally charged language about Japanese people, mostly negative. The symmetry broke. Maybe “Japanese person” was used 60-40 positive vs. negative, and “Jap” was used 40-60. This isn’t enough to make a slur, but it’s enough to make a vague connotation. When people wanted to speak positively about the group, they used the slightly-more-positive-sounding “Japanese people”; when they wanted to speak negatively, they used the slightly-more-negative-sounding “Jap”. At some point, someone must have commented on this explicitly: “Consider not using the word ‘Jap’, it makes you sound hostile”. Then anyone who didn’t want to sound hostile to the Japanese avoided it, and anyone who did want to sound hostile to the Japanese used it more. We started with perfect symmetry: both forms were 50-50 positive negative. Some chance events gave it slight asymmetry: maybe one form was 60-40 negative. Once someone said “That’s a slur, don’t use it”, the symmetry collapsed completely and it became 95-5 or something. Wikipedia gives the history of how the last few holdouts were mopped up. There was some road in Texas named “Jap Road” in 1905 after a beloved local Japanese community member: people protested that now the word was a slur, demanded it get changed, Texas resisted for a while, and eventually they gave in. Now it is surely 99-1, or 99.9-0.1, or something similar. Nobody ever uses the word “Jap” unless they are either extremely ignorant, or they are deliberately setting out to offend Japanese people. This is a very stable situation. The original reason for concern - World War II - is long since over. Japanese people are well-represented in all areas of life. Perhaps if there were a Language Czar, he could declare that the reasons for forbidding the word “Jap” are long since over, and we can go back to having convenient short forms of things. But there is no such Czar. What actually happens is that three or four unrepentant racists still deliberately use the word “Jap” in their quest to offend people, and if anyone else uses it, everyone else takes it as a signal that they are an unrepentant racist. Any Japanese person who heard you say it would correctly feel unsafe. So nobody will say it, and they are correct not to do so. Like I said, a stable situation.

https://astralcodexten.substack.com/p/issue-two-of-asterisk …the new-ish rationalist / effective altruist magazine, is up here. It’s the food issue. I’m not in this one - my unsuitability to have food-related opinions is second only to @eigenrobot’s - but some of my friends are. Articles include: The Virtue Of Wonder: Ozy (my ex, blogs at Thing of Things) reviews Martha Nussbaum’s Justice For Animals. Beyond Staple Grains: In the ultimate “what if good things are bad?” article, economist Prabhu Pingali explains the downsides of the Green Revolution and how scientists and policymakers are trying to mitigate them. What I Won’t Eat, by my good friend Georgia Ray (of Eukaryote Writes). I have dinner with Georgia whenever I’m in DC; it’s a less painful experience than this article probably suggests. The Health Debates Over Plant-Based Meat, by Jake Eaton (is this nominative determinism?) There’s no ironclad evidence yet that plant-based meat is any better or worse for you than animals, although I take the pro-vegetarian evidence from the Adventist studies a little more seriously than Jake does (see also section 4 here). There’s a prediction market about the question below the article, but it’s not very well-traded yet. America Doesn’t Know Tofu, by George Stiffman. This reads like an excerpt from a cultivation novel, except every instance of “martial arts” has been CTRL-F’d and replaced with “tofu”. Read This, Not That, by Stephan Guyenet. I’m a big fan of Stephan’s scientific work (including his book The Hungry Brain), and although I’m allergic to anything framed as “fight misinformation”, I will grudgingly agree that perhaps we should not all eat poison and die. Is Cultivated Meat For Real?, by Robert Yaman. I’d heard claims that cultivated (eg vat-grown, animal-cruelty-free) meat will be in stores later this year, and also claims that it’s economically impossible. Which are true? This article says that we’re very far away from cultivated meat that can compete with normal meat on price. But probably you can mix a little cultivated meat with Impossible or Beyond Meat and get something less expensive than the former and tastier than the latter, and applications like these might be enough to support cultivated meat companies until they can solve their technical obstacles. Plus superforecaster Juan Cambeiro on predicting pandemics, Mike Hinge on feeding the world through nuclear/volcanic winter.

https://astralcodexten.substack.com/p/kelly-bets-on-civilization Scott Aaronson makes the case for being less than maximally hostile to AI development: Here’s an example I think about constantly: activists and intellectuals of the 70s and 80s felt absolutely sure that they were doing the right thing to battle nuclear power. At least, I’ve never read about any of them having a smidgen of doubt. Why would they? They were standing against nuclear weapons proliferation, and terrifying meltdowns like Three Mile Island and Chernobyl, and radioactive waste poisoning the water and soil and causing three-eyed fish. They were saving the world. Of course the greedy nuclear executives, the C. Montgomery Burnses, claimed that their good atom-smashing was different from the bad atom-smashing, but they would say that, wouldn’t they? We now know that, by tying up nuclear power in endless bureaucracy and driving its cost ever higher, on the principle that if nuclear is economically competitive then it ipso facto hasn’t been made safe enough, what the antinuclear activists were really doing was to force an ever-greater reliance on fossil fuels. They thereby created the conditions for the climate catastrophe of today. They weren’t saving the human future; they were destroying it. Their certainty, in opposing the march of a particular scary-looking technology, was as misplaced as it’s possible to be. Our descendants will suffer the consequences. Read carefully, he and I don’t disagree. He’s not scoffing at doomsday predictions, he’s more arguing against people who say that AIs should be banned because they might spread misinformation or gaslight people or whatever.  

https://astralcodexten.substack.com/p/impact-market-mini-grants-update Impact markets are a charity analogy to private equity. Instead of prospectively giving grants to projects they hope will work, charitable foundations retrospectively give grants to projects that did work. Investors fund those projects prospectively, then recover their money through the grants. This offloads the responsibility of predicting which projects will succeed - and the risks from unsuccessful projects - from charitable foundations to investors with skin in the game.  

https://astralcodexten.substack.com/p/against-ice-age-civilizations There’s a good debate about this on the subreddit; see also Robin Hanson and Samo Burja. You can separate these kinds of claims into three categories: Civilizations about as advanced as the people who built Stonehenge Civilizations about as advanced as Pharaonic Egypt Civilizations about as advanced as 1700s Great Britain The debate is confused by people doing a bad job clarifying which of these categories they’re proposing, or not being aware that the other categories exist. 2 and 3 aren’t straw men. Robert Schoch says the Sphinx was built in 9700 BC, which I think qualifies as 2. Graham Hancock suggests “ancient sea kings” drew the Piri Reis map which seems to depict Antarctica; anyone who can explore Antarctica must be at least close to 1700s-British level. I think there’s weak evidence against level 1 civilizations, and strong evidence against level 2 or 3 civilizations.

https://astralcodexten.substack.com/p/openais-planning-for-agi-and-beyond Planning For AGI And Beyond Imagine ExxonMobil releases a statement on climate change. It’s a great statement! They talk about how preventing climate change is their core value. They say that they’ve talked to all the world’s top environmental activists at length, listened to what they had to say, and plan to follow exactly the path they recommend. So (they promise) in the future, when climate change starts to be a real threat, they’ll do everything environmentalists want, in the most careful and responsible way possible. They even put in firm commitments that people can hold them to.

Plus: A case for culture-bound mental disorder skepticism https://astralcodexten.substack.com/p/highlights-from-the-comments-on-geography [Original post: The Geography Of Madness] Thomas Reilly (author of Rational Psychiatry) writes: I don’t think Bouffée délirante is a culture bound syndrome - it’s just the French equivalent of brief psychotic disorder (DSM), acute and transient psychotic disorder (ICD), or Brief Limited Intermittent Psychotic symptoms (CAARMS). [See] https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8581951/ I responded “Have you ever seen BPS? I almost never have, and was told it was mostly used as a code for new-onset schizophrenia that didn't satisfy the time criterion yet,” and Dr. Reilly wrote: Yes, in the context of an At Risk Mental State service, where it makes up roughly 20% of referrals https://www.sciencedirect.com/science/article/pii/S0924977X20302510 .

https://astralcodexten.substack.com/p/announcing-forecasting-impact-mini I still dream of running an ACX Grants round using impact certificates, but I want to run a lower-stakes test of the technology first. In conjunction with the Manifold Markets team, we’re announcing the Forecasting Impact Mini-Grants, a $20,000 grants round for forecasting projects. As a refresher, here’s a short explainer about what impact certificates are, and here’s a longer article on various implementation details.

https://astralcodexten.substack.com/p/book-review-the-geography-of-madness Around the wide world, all cultures share a few key features. Anthropologists debate the precise extent, but the basics are always there. Language. Tools. Marriage. Family. Ritual. Music. And penis-stealing witches. Nobody knows when the penis-stealing witches began their malign activities. Babylonian texts include sa-zi-ga, incantations against witchcraft-induced impotence. Ancient Chinese sources describe suo yang, the penis retracting into the body because of yin/yang imbalances. But the first crystal-clear reference was the Malleus Maleficarum, the 15th-century European witch-hunters’ manual. It included several chapters on how witches cast curses that apparently (though not actually) remove men’s penises.