Scaling Up Language Models

I've been really impressed with sort of the general intelligence of language models so far as just as you scale them up. And it's hard to say because we don't have good enough interpretability tools, but I think what's going on here is something that will be a game-changer for us all in the near future. The reason I think this is that, yeah, just looking, I was like, well, why can't you just take the nuclear reactors you have and use them to like make plutonium and then you can make bombs out of plutonium? But they're harder to make. They're also more complicated than our breeder reactors. So nations don't build them as