4 ms·

But isn’t it still way too expensive? Performance wise that P100 is close to GeForce 1080. That GPU currently retails for $550. For the price of 1 month of pr

But isn’t it still way too expensive? Performance wise that P100 is close to GeForce 1080. That GPU currently retails for $550. For the price of 1 month of preemptive google’s IaaS you can buy the GPU and use it for as long as you want only paying very small amount (depending on where you are $0.02-$0.1/hour) for electricity.

aeleos 9y ago
I think its more about the flexibility of having access to more resources than you can ever need. If you buy a 1080 then you are limited by its performance and say you wanted to train to models at the same time, you are even more limited. Whereas with something like this you could train 10 models right when you need them trained, and you aren't stuck with 10 gpus that you bought so you could do that.
- Const-me 9y ago
  I understand the IaaS is way more flexible, e.g. in cases when you need lots of GPUs but not for long the cloud is a clear winner. However, IMO the price is just not OK. Compare with traditional servers. For $0.7/hour you can use e.g. c4.4xlarge amazon instance. The hardware is much more expensive than $550, just the RAM is already around $400. You won’t be able to purchase an equally-performing server for 1 month of that IaaS rent, I think it’ll be like 3-6 months (which is IMO reasonable).
  - tw04 9y ago
    That's because they can amortize the server over a longer time window than a GPU.
    - candiodari 9y ago
      If that's true, then why are they still running the K80s ?
      - tw04 9y ago
        They didn't add the K80s until February of 2017, did you really think they'd literally throw out hardware after less than 12 months? "Accelerated" means 18-36 month shelf life, not 10.
agentdrtran 9y ago
Those GPUs needs to be located somewhere (in a housing), with power, and won't include any of Google's nice software stack to use the.
jsmthrowaway 9y ago
> That GPU currently retails for $550. If you can find one.
- Klinky 9y ago
  nVidia GPUs are pretty easy to get your hands on. Plenty of 1080s from $550 - $600 on NewEgg. AMD GPUs are not as easy to find.
  - mv4 9y ago
    Are you sure about that? all sub-$600 GTX 1080 offers are "out of stock". The ones that aren't, are asking $1,200+ per. https://www.newegg.com/Product/ProductList.aspx?Submit=ENE&N=100007709&IsNodeId=1&Description=gtx%201080&name=Desktop%20Graphics%20Cards&Order=BESTMATCH&isdeptsrh=1 https://www.newegg.com/Product/ProductList.aspx?Submit=ENE&N...
anonfunction 9y ago
You’ll need at least some more components to run your GPU like a CPU, motherboard, etc... not to mention a reliable network, power and other ancillary services. The real power of cloud is not a replacement of one instance but the ability to turn on tens, hundreds or even thousands of nodes.

aeleos 9y ago

I think its more about the flexibility of having access to more resources than you can ever need. If you buy a 1080 then you are limited by its performance and say you wanted to train to models at the same time, you are even more limited. Whereas with something like this you could train 10 models right when you need them trained, and you aren't stuck with 10 gpus that you bought so you could do that.

Const-me 9y ago
I understand the IaaS is way more flexible, e.g. in cases when you need lots of GPUs but not for long the cloud is a clear winner. However, IMO the price is just not OK. Compare with traditional servers. For $0.7/hour you can use e.g. c4.4xlarge amazon instance. The hardware is much more expensive than $550, just the RAM is already around $400. You won’t be able to purchase an equally-performing server for 1 month of that IaaS rent, I think it’ll be like 3-6 months (which is IMO reasonable).
- tw04 9y ago
  That's because they can amortize the server over a longer time window than a GPU.
  - candiodari 9y ago
    If that's true, then why are they still running the K80s ?
    - tw04 9y ago
      They didn't add the K80s until February of 2017, did you really think they'd literally throw out hardware after less than 12 months? "Accelerated" means 18-36 month shelf life, not 10.

agentdrtran 9y ago

Those GPUs needs to be located somewhere (in a housing), with power, and won't include any of Google's nice software stack to use the.

jsmthrowaway 9y ago

> That GPU currently retails for $550. If you can find one.

Klinky 9y ago
nVidia GPUs are pretty easy to get your hands on. Plenty of 1080s from $550 - $600 on NewEgg. AMD GPUs are not as easy to find.
- mv4 9y ago
  Are you sure about that? all sub-$600 GTX 1080 offers are "out of stock". The ones that aren't, are asking $1,200+ per. https://www.newegg.com/Product/ProductList.aspx?Submit=ENE&N=100007709&IsNodeId=1&Description=gtx%201080&name=Desktop%20Graphics%20Cards&Order=BESTMATCH&isdeptsrh=1 https://www.newegg.com/Product/ProductList.aspx?Submit=ENE&N...

anonfunction 9y ago

You’ll need at least some more components to run your GPU like a CPU, motherboard, etc... not to mention a reliable network, power and other ancillary services. The real power of cloud is not a replacement of one instance but the ability to turn on tens, hundreds or even thousands of nodes.