The Future of Tokens

The data situation is still quite good. There are still lots to go. How many orders of magnitude improvement can we get just not from scale or not from data, but just from algorithmic improvements? Hard to answer, but I'm sure there is some. Is some a lot or is some a little? I mean, so only one way to find out. Okay. Let me get your like quick fire opinions about these different research directions. Retreatable transformers. Do you see that as a path forwarder? I think it seems promising. Robotics. Was it the right step for OpenAI to leave that behind? Back then it really wasn't possible to continue working on robotics because