3 ms·

That website is kind of sketchy. The blog on it doesn't link anywhere. Is it yours?

by kick 7y ago

Const-me 7y ago
Not mine, found by DDG by a question like “rent 1080Ti GPU”, and there're more. I don’t need their services, but I think the prices are reasonable. Nvidia is way too greedy, they charged $5000 for server equivalent of a $700 consumer GPU. The major difference between the two GPUs is legal, not technical. Cloud providers like Google or Amazon have little choice but to pass the cost to users.
- rrss 7y ago
  The server class gpus are generally different silicon than the consumer gpus. That's a technical difference.
  - Const-me 7y ago
    > generally different silicon 1080Ti / P100: Chip: GP102 / GP100 Cores: 3584 / 3584 Base clock: 1480 / 1328 Single precision TFlops: 10.6 / 10.6 TDP, Watts: 250 / 300 The only major difference of the chip is double precision performance, probably irrelevant for the OP's task. And I'm not convinced the difference is in the silicon as opposed to firmware or drivers, games don't need doubles so the NV could cripple the consumer model without consequences, just to differentiate the two products.
    - kick 7y ago
      You don't seem to be familiar with binning.
      - Const-me 7y ago
        I am, but I think greed contributes much more to the price. nVidia also made Tesla P40. It has 100% identical chip to the 1080Ti, same GP102, same frequencies, 100% same specs. The price is around $5000. The GPU is not 100% same, it has more VRAM, but still, that's 8x price difference for almost identical products. If Teslas would be better, nVidia wouldn't need to put that ridiculous paragraph in the EULA of the driver, about data center usage. That paragraph is the only reason why we don't have affordable GPGPUs in AWS.
    - rrss 7y ago
      GP100 and GP102 are different sizes. They are certainly different silicon - the die area can't be changed in firmware or drivers. From techpowerup: GP100: 610 mm^2 GP102: 471 mm^2
      - Const-me 7y ago
        Good point. You’re right, they are different chips. But still, the only difference is double precision performance (that’s probably what these extra transistors do), and support of HBM2 memory as opposed to GDDR5X. Pretty sure Amazon/Google/MS would be happy to offer affordable cloud-based GP102-s, if they could.
gwern 7y ago
Vast.ai is a little obscure but it's a real functioning service, and pretty nifty. I used it awhile ago to rent an 8-GPU machine for way less than AWS would've cost: https://www.gwern.net/Faces#biggan https://www.gwern.net/Faces#biggan

That website is kind of sketchy. The blog on it doesn't link anywhere. Is it yours?

by kick 7y ago

That website is kind of sketchy. The blog on it doesn't link anywhere. Is it yours?

Not mine, found by DDG by a question like “rent 1080Ti GPU”, and there're more. I don’t need their services, but I think the prices are reasonable. Nvidia is way too greedy, they charged $5000 for server equivalent of a $700 consumer GPU. The major difference between the two GPUs is legal, not technical. Cloud providers like Google or Amazon have little choice but to pass the cost to users.

rrss 7y ago
The server class gpus are generally different silicon than the consumer gpus. That's a technical difference.
- Const-me 7y ago
  > generally different silicon 1080Ti / P100: Chip: GP102 / GP100 Cores: 3584 / 3584 Base clock: 1480 / 1328 Single precision TFlops: 10.6 / 10.6 TDP, Watts: 250 / 300 The only major difference of the chip is double precision performance, probably irrelevant for the OP's task. And I'm not convinced the difference is in the silicon as opposed to firmware or drivers, games don't need doubles so the NV could cripple the consumer model without consequences, just to differentiate the two products.
  - kick 7y ago
    You don't seem to be familiar with binning.
    - Const-me 7y ago
      I am, but I think greed contributes much more to the price. nVidia also made Tesla P40. It has 100% identical chip to the 1080Ti, same GP102, same frequencies, 100% same specs. The price is around $5000. The GPU is not 100% same, it has more VRAM, but still, that's 8x price difference for almost identical products. If Teslas would be better, nVidia wouldn't need to put that ridiculous paragraph in the EULA of the driver, about data center usage. That paragraph is the only reason why we don't have affordable GPGPUs in AWS.
  - rrss 7y ago
    GP100 and GP102 are different sizes. They are certainly different silicon - the die area can't be changed in firmware or drivers. From techpowerup: GP100: 610 mm^2 GP102: 471 mm^2
    - Const-me 7y ago
      Good point. You’re right, they are different chips. But still, the only difference is double precision performance (that’s probably what these extra transistors do), and support of HBM2 memory as opposed to GDDR5X. Pretty sure Amazon/Google/MS would be happy to offer affordable cloud-based GP102-s, if they could.

gwern 7y ago

Vast.ai is a little obscure but it's a real functioning service, and pretty nifty. I used it awhile ago to rent an 8-GPU machine for way less than AWS would've cost: https://www.gwern.net/Faces#biggan https://www.gwern.net/Faces#biggan