Understanding Tensor Parallelism in AI Models

Emily Webber speaks to Jon Krohn about her work at Amazon Web Services, from its Annapurna Labs-developed Nitro System, a foundational technology that can enhance securities and performance in the cloud and how Trainium2 became AWS’ most powerful AI chip with four times the compute of Trainium. Hear the specs of AWS’s chips and when to use them.

Additional materials: www.superdatascience.com/881

This episode is brought to you by ODSC, the Open Data Science Conference.

Interested in sponsoring a SuperDataScience Podcast episode? Email natalie@superdatascience.com for sponsorship information.

In this episode you will learn:

• (08:36) Emily’s work on AWS’ SageMaker and Trainium 
• (23:54) How AWS Neuron lets builders tailor their approach to using frameworks 
• (29:07) Why using an accelerator is better than using a GPU 
• (35:29) The key differences between AWS Trainium and AWS Trainium2 
• (52:45) How to select between AWS Trainium and AWS Trainium2