3 ms·
> In total it scaled up about 3,000 T4 GPUs per platform > why I burned $150 on GPUs How do you rent 3000 GPUs over a period of weeks for $150? Were they lite
by zmmmmm 4y ago
> In total it scaled up about 3,000 T4 GPUs per platform
> why I burned $150 on GPUs
How do you rent 3000 GPUs over a period of weeks for $150? Were they literally requisitioning it and releasing it immediately? Seems like this is quite a unrealistic type of usage pattern and would depend a lot on whether the cloud provider optimises to hand you back the same warm instance you just relinquished.
> GCP allows you to attach a GPU to an arbitrary VM as a hardware accelerator
it's quite fascinating that GCP can do this. GPUs are physical things (!) do they provision every single instance type in the data center with GPUs? That would seem very expensive.
- bushbaba 4y agoUnlikely. More likely they put your VM on a host with GPU attached, and use live migration to move workloads around for better resource utilization. However, live-migration can cause impact to HPC workloads.
- ZiiS 4y agoGPUs are physical but VMs are not; I expect they just move them to a host with a GPU.
- NavinF 4y agoIt probably live-migrates your VM to a physical machine that has a GPU available. ...if there are any GPUs available in the AZ that is. I had a hell of a time last year moving back and forth between regions to grab just 1 GPU to test something. The web UI didn't have a "any region" option for launching VMs so if you don't use the API you'll have to sit there for 20 minutes trying each AZ/region until you managed to grab one.
- geysersam 4y ago> $150 Was asking myself the same question. From the pricing information on gcp it seems minimum billing time is 1 minute, making 3000 GPUs cost $50 minimum. If this is the case then $150 is reasonable for the kind of usage pattern you describe.