AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Future of AI Training Hardware
I do think that if China cannot get a 100s, H 100s top the line hardware like GPUs with good interconnect to train models, they will invest heavily in solving that problem. And so there is a piece of me that feels that some of the regulatory attempts to control model development are misguided. I think separately from that, there's another interesting vein that you and I have talked about where like you're trying to figure out how to make more heterogeneous compute work for both inference and training. That could be companies like Together or Foundry or even at the sort of compiler layer, like HIPAA.