AWS has different pools of EC2 instances depending on the customer, the size of the account and any reservations you may have. Spawning a single GPU at varying

AWS has different pools of EC2 instances depending on the customer, the size of the account and any reservations you may have. Spawning a single GPU at varying times is nothing. Try spawning more than one, or using spot instances, and you’ll get a very different picture. We often run into capacity issues with GPU and even the new m6i instances at all times of the day. Very few realistic company size workloads need a single GPU. I would willingly wait 30 minutes for my instances to become available if it meant all of them where available at the same time.