4 ms·

The pricing doesn't look that compelling, here are the hourly rate comparisons vs runpod.io vs vast.ai: 1x L4 24GB: google: $0.71; runpod.io: $0.43, s

by mythz 1y ago

The pricing doesn't look that compelling, here are the hourly rate comparisons vs runpod.io vs vast.ai: 1x L4 24GB: google: $0.71; runpod.io: $0.43, spot: $0.22 4x L4 24GB: google: $4.00; runpod.io: $1.72, spot: $0.88 1x A100 80GB: google: $5.07; runpod.io: $1.64, spot: $0.82; vast.ai $0.880, spot: $0.501 1x H100 80GB: google: $11.06; runpod.io: $2.79, spot: $1.65; vast.ai $1.535, spot: $0.473 8x H200 141GB: google: $88.08; runpod.io: $31.92; vast.ai $15.470, spot: $14.563 Google's pricing also assumes you're running it 24/7 for an entire month, where as this is just the hourly price for runpod.io or vast.ai which both bill per second. Wasn't able to find Google's spot pricing for GPUs.

counters 1y ago
Nothing but 1xL4 are even offered on Cloud Run GPUs, are they?
ZiiS 1y ago
I think the Google prices are billed per-second so under 20min you are better on Google?
- thousand_nights 1y ago
  runpod is billed by the minute
  - bts4 1y ago
    Technically we bill Pods by the millisecond. Pennies matter :)
- mythz 1y ago
  RunPod also charges per second [1], also this is Google's expected avg cost per hour after running it 24/7 for an entire month, I couldn't find an hourly cost for each GPU. When you need under <1hr than you can go with Runpod's Spot pricing which is ~4-7x cheaper than Google, where even 20min of Google would cost more than 1hr on RunPod. [1] https://docs.runpod.io/serverless/pricing https://docs.runpod.io/serverless/pricing
otherjason 1y ago
Where did you get the pricing for vast.ai here? Looking at their pricing page, I don't see any 8xH200 options for less than $21.65 an hour (and most are more than that).
- zackangelo 1y ago
  I think it’s a typo, looks pretty close to their 8xH100 prices.
steren 1y ago
> Google's pricing also assumes you're running it 24/7 for an entire month What makes you think that? Cloud Run [pricing page](https://cloud.google.com/run/pricing https://cloud.google.com/run/pricing) explicitly says : "charge you only for the resources you use, rounded up to the nearest 100 millisecond" Also, Cloud Run's [autoscalling](https://cloud.google.com/run/docs/about-instance-autoscaling https://cloud.google.com/run/docs/about-instance-autoscaling) is in effect, scaling down idle instances after a maximum of 15 minutes. (Cloud Run PM)
- mythz 1y ago
  Because the pricing when creating an instance shows me the cost for the entire month, then works out the average hourly price based on that. This is just creating a GPU VM instance, I don't see how to see the cost of different NVidia GPUs without it. If you wanted to show hourly pricing, you would show that first, then calculate the monthly price from the hourly rate. I've no idea if the monthly cost includes sustained usage discount and what the hourly cost is for just running it for an hour.
  - steren 1y ago
    > Because the pricing when creating an instance shows me the cost for the entire month Are you referring to the GCP pricing calculator? > This is just creating a GPU VM instance Maybe you are referring to the Compute Engine VM creation page? Cloud Run is a different GCP service. The Cloud Run Service creation UI doesn't show the cost.
progbits 1y ago
You can just go to "create compute instance" to see the spot pricing. Eg GCP price for spot 1xH100 is $2.55/hr, lower with sustained use discounts. But only hobbyists pay these prices, any company is going to ask for a discount and will get it.

by mythz 1y ago

counters 1y ago

Nothing but 1xL4 are even offered on Cloud Run GPUs, are they?

ZiiS 1y ago

I think the Google prices are billed per-second so under 20min you are better on Google?

thousand_nights 1y ago
runpod is billed by the minute
- bts4 1y ago
  Technically we bill Pods by the millisecond. Pennies matter :)
mythz 1y ago
RunPod also charges per second [1], also this is Google's expected avg cost per hour after running it 24/7 for an entire month, I couldn't find an hourly cost for each GPU. When you need under <1hr than you can go with Runpod's Spot pricing which is ~4-7x cheaper than Google, where even 20min of Google would cost more than 1hr on RunPod. [1] https://docs.runpod.io/serverless/pricing https://docs.runpod.io/serverless/pricing

otherjason 1y ago

Where did you get the pricing for vast.ai here? Looking at their pricing page, I don't see any 8xH200 options for less than $21.65 an hour (and most are more than that).

zackangelo 1y ago
I think it’s a typo, looks pretty close to their 8xH100 prices.

steren 1y ago

> Google's pricing also assumes you're running it 24/7 for an entire month What makes you think that? Cloud Run [pricing page](https://cloud.google.com/run/pricing https://cloud.google.com/run/pricing) explicitly says : "charge you only for the resources you use, rounded up to the nearest 100 millisecond" Also, Cloud Run's [autoscalling](https://cloud.google.com/run/docs/about-instance-autoscaling https://cloud.google.com/run/docs/about-instance-autoscaling) is in effect, scaling down idle instances after a maximum of 15 minutes. (Cloud Run PM)

mythz 1y ago
Because the pricing when creating an instance shows me the cost for the entire month, then works out the average hourly price based on that. This is just creating a GPU VM instance, I don't see how to see the cost of different NVidia GPUs without it. If you wanted to show hourly pricing, you would show that first, then calculate the monthly price from the hourly rate. I've no idea if the monthly cost includes sustained usage discount and what the hourly cost is for just running it for an hour.
- steren 1y ago
  > Because the pricing when creating an instance shows me the cost for the entire month Are you referring to the GCP pricing calculator? > This is just creating a GPU VM instance Maybe you are referring to the Compute Engine VM creation page? Cloud Run is a different GCP service. The Cloud Run Service creation UI doesn't show the cost.

progbits 1y ago

You can just go to "create compute instance" to see the spot pricing. Eg GCP price for spot 1xH100 is $2.55/hr, lower with sustained use discounts. But only hobbyists pay these prices, any company is going to ask for a discount and will get it.