>rare 10 minute peaks But is that really the use case here? I haven't worked in ML. But I'm not seeing where you are going to need to handle a 10 minute spike

>rare 10 minute peaks But is that really the use case here? I haven't worked in ML. But I'm not seeing where you are going to need to handle a 10 minute spike that requires a whole datacenter. A month's worth of a quad gpu instance on AWS could pay for a server with similar capacity in a few months of usage. And hardware is pretty resilient these days. Especially if you co-locate it in a datacenter that handles all the internet and power up time for you. And when something does go wrong, they offer "magic hands" service to go swap out hardware for you. Colocation is surprisingly cheap. As is leasing 'managed' equipment.