AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
3min chapter
Multi-GPU training is hard (without PyTorch Lightning)
Practical AI: Machine Learning, Data Science, LLM
Is It Better to Train on a Grid?
Training models on gps in the cloud is always going to be more expensive than training on a sort of, like you're going to buy a on prem server and do it in house. People don't generally optimize their stuff in the back end to do that. So what the end of doing is they want to run inthe local machines, because they don't have to instelt their environments again. It's just there, and it's reputable, and things start immediately. Spot instances are machines that can be killed at any time by a w s, right? Or whatever. And then if i'm getting more minutes out of that, that nouveau factor plus other stuff,
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode