The Importance of Scaling GBT3 Models

Gorn deserves a lot of the credit for like really spreading the scaling meme in the alignment community. I basically saw an arbitrage opportunity is that there were a ton of people who should be doing research on these models, but clearly did not have the engineering and funding to build these models themselves. So I had a bunch of nerds who wanted to do this for fun anyways. And turns out, yeah, my experience, that was a really good idea. Most of my knowledge, like my competitive advantage that I have in other people is gained from just actually building the things, actually staring at them really hard. There's an illustrious scientific history of the method of just staring at an object very hard