How to Rent GPUs for Your Machine

It's all very well to run 7 billion, 13 billion parameters locally, but you're not working with the state of the art if you're doing that. The alternative is to essentially either spend $20,000, $30,000 and buy yourself one of the really high end cards that's capable of doing this on your own. Or you're renting these clusters and renting servers on clusters to be able to do it. And I'm not even talking about training your own models. Like if you just wanted to play around with llama 70 billion, yeah, you can try it on hugging face. But if you want to experiment with it, that's not really a sustainable way to

Transcript

Play full episode

Transcript

Episode notes

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!

Get the app