5 ms·

Spending actual money on GCP. I don't have any GCP credits. I asked for just 1 GPU and explained that I need to run 20GB+ models. Didn't realize they expect a

Spending actual money on GCP. I don't have any GCP credits. I asked for just 1 GPU and explained that I need to run 20GB+ models. Didn't realize they expect a doctorate application in that 3-line textbox. All of it is so bureaucratic. I have to look up their zone-GPU mapping. I have to test availability indirectly via the quota workflow route. It reminds me of my country's shitty bureaucracy! I tried 3 zones. In one zone, a GPU is granted in the quota but still shows quota error on the main UI. The other 2 zones were denied. If they don't have any to rent, I don't know why they don't just say that. Instead, they expect an onerous workflow of requesting quota increases with pathetic user experience, only to deny them and notify the denials via email. Any suggestions for Colab alternatives?

verdverm 3y ago
I have had no issues with GCP quotas, you are exaggerating the situation out of frustration, understandable. The turn around is typically a few minutes, and if you haven't tried this on other clouds, you don't know how good that is. There is a single page list of GPU availability by zone: https://cloud.google.com/compute/docs/gpus/gpu-regions-zones https://cloud.google.com/compute/docs/gpus/gpu-regions-zones You do not have to write a "doctorate" but you do need to explain your need, not the what will you do. again, A100s are in very high demand, so everyone is preferring the highest value customers first. Did you get a A100 in one zone? The error messages for "you are out of quota" vs "(google) resource not available" look similar. We have devs getting them confused all the time
- lovelearning 3y ago
  I don't think I'm exaggerating - I wasted hours today on their terrible workflow and UI. All of that can be simplified and automated by Google via their frontend instead of a workflow that expects users to visit multiple pages. I have a quota of 1 GPU in one zone and zero allocated GPUs. I keep seeing only "exceeded quota by 1 GPU" error on their UI when trying to create a VM for that single GPU in the correct zone. Thank you for the replies. Looks like most users are fine with all this. I'll probably explore non-GCP alternatives.
  - verdverm 3y ago
    you're welcome For GPUs (among others), there are two quotas, regional and zonal. We have N regional T4s and unlimited zonal. Maybe you have 1 zonal and 0 regional? If you just need a GPU, there may indeed be better or cheaper providers

verdverm 3y ago

I have had no issues with GCP quotas, you are exaggerating the situation out of frustration, understandable. The turn around is typically a few minutes, and if you haven't tried this on other clouds, you don't know how good that is. There is a single page list of GPU availability by zone: https://cloud.google.com/compute/docs/gpus/gpu-regions-zones https://cloud.google.com/compute/docs/gpus/gpu-regions-zones You do not have to write a "doctorate" but you do need to explain your need, not the what will you do. again, A100s are in very high demand, so everyone is preferring the highest value customers first. Did you get a A100 in one zone? The error messages for "you are out of quota" vs "(google) resource not available" look similar. We have devs getting them confused all the time

lovelearning 3y ago
I don't think I'm exaggerating - I wasted hours today on their terrible workflow and UI. All of that can be simplified and automated by Google via their frontend instead of a workflow that expects users to visit multiple pages. I have a quota of 1 GPU in one zone and zero allocated GPUs. I keep seeing only "exceeded quota by 1 GPU" error on their UI when trying to create a VM for that single GPU in the correct zone. Thank you for the replies. Looks like most users are fine with all this. I'll probably explore non-GCP alternatives.
- verdverm 3y ago
  you're welcome For GPUs (among others), there are two quotas, regional and zonal. We have N regional T4s and unlimited zonal. Maybe you have 1 zonal and 0 regional? If you just need a GPU, there may indeed be better or cheaper providers