Introduction to EC2 Capacity Blocks for Machine Learning

EC2 capacity blocks are a new usage model in Amazon EC2 designed to simplify and democratize machine learning. Customers can reserve GPU instances for the exact duration they need to train and deploy machine learning and generative AI models. By reserving capacity only when needed, customers can avoid holding onto underutilized GPU instances. Capacity blocks are currently available for key five instances powered by NVIDIA H100 tensor core GPUs. They can be easily reserved through the EC2 console. This new reservation model provides flexibility and cost efficiency for customers with fluctuating GPU capacity needs.