The Toxic Meme in the Alignment World

I think 99% of the damage from GB3 was done the moment the paper was published. I agree that in the ideal case, the correct case is for large, well-funded groups to do AGI research internally and never tell a soul about it. There's a lot of hindsight bias there in that people don't realize how everyone knew about this except the alignment community. Illusory made very clear from day one that we would never release something beyond the state of the art. If we had stumbled upon something that was beyond anything else, we would not have released it.