MLOps.community  cover image

The Rise of Modern Data Management // Chad Sanderson // #226

MLOps.community

CHAPTER

Promotion of AWS Trainium and Inferentia for Generative AI Applications

Learn about how AWS's Trainium and Inferentia provide high-performance compute infrastructure for training and inference with LLMs and diffusion models, offering cost savings of up to 50% on training and up to 40% on inference costs while supporting popular frameworks like PyTorch and TensorFlow.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner