The Scaling Hypothesis

The bigger you make these systems, the more general purpose they become. And I think it's got really interesting implications for the scaling argument. What this seems to suggest is actually, if you keep growing the system,If you keep scaling it, you will actually get to a point where you get positive transfer between tasks. The skills that you learn by learning to drive a car really well, all of a sudden you find, oh, shit, I'm clever enough to pull out the salient lessons from that task and apply them to video games or something.