AI Tools Aren't Well Documented

CNNs in the 90s were very well kind of motivated by human perception when they came out actually in the 80s. Whereas transformers are a bit more of a sort of just discovery that happened. And so I guess there would be some hope that if we do more of these kinds of studies, you know, what is the next transformer? Maybe we can have a more principled way to figure that out and find this next architecture.