AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Hot New Thing in Transformers
The next paper that we wanted to talk about is a goat, a global transformer on large scale graphs. The many years that I've followed some of the work at Capital One, graphs and graph neural networks has always been kind of a common theme. In our case, you can imagine every time that you swipe a credit card, you are establishing an edge between you and the merchant. That scales up to functionally the many tens of millions of a node network with billions of edges. It contains a lot of very useful structural information that we can use in a wide range of applications.