3 ms·
What are your thoughts on the generally slower launch times with a huge variance on GCP?
by mempko 4y ago
What are your thoughts on the generally slower launch times with a huge variance on GCP?
- kevincox 4y agoFWIW in our use case of non-GPU instances they launched way faster and more consistently on GCP than AWS. So I guess it is complicated and may depend on exactly what instance you are launching.
- Crash0v3rid3 4y agoThe author failed to mention which regions these tests were run. GPU availability can vary depending on the regions that were tested for both Cloud providers.
- fomine3 4y agoThis is a big missed point.
- ayewo 4y agoThe author linked to the code at the end of the post. The regions used are "us-east-1" for AWS [1] and "us-central1-b" for GCP [2]. 1: https://github.com/piercefreeman/cloud-gpu-reliability/blob/4cfd6817c9233e1c01482f6233d39fa8529dc7f1/gpu_reliability/cli.py#L39 https://github.com/piercefreeman/cloud-gpu-reliability/blob/... 2: https://github.com/piercefreeman/cloud-gpu-reliability/blob/4cfd6817c9233e1c01482f6233d39fa8529dc7f1/gpu_reliability/cli.py#L36 https://github.com/piercefreeman/cloud-gpu-reliability/blob/...
- valleyjo 4y agoJust remember this is for GPU instances. Other vm families are pretty fast to launch.
- jhugo 4y agoAt work we run some (non-GPU) instances in every AWS region, and there's pretty big variability over time and region for on-demand launch time. I'd expect it might be even higher for GPU instances. I suspect that a more rigorous investigation might find there isn't quite as big a difference overall as this article suggests.