Google's new TPUs are 1.5 times faster than the Nvidia A100, which is kind of the workhorse GPU today. But what they don't compare it to is the H100, a lot faster, at least according to Nvidia, it's like four times faster. Elon Musk is moving forward with a new generative AI project at Twitter after purchasing thousands of GPUs.