5 ms·
Nvidia's 900 tons of GPU muscle bulks up server market, slims down wallets
- _joel 3y agoNow that's what I call Big Iron
- jerjerjer 3y agoVery strange metric considering actual GPU is probably below 1% of the shipped weight.
- green-salt 3y agoI'm glad they're measuring by weight instead of volume for more accuracy
- a1o 3y agoIf someone can come up with the average density of a video card we can convert to volume!
- mensetmanusman 3y agoProbably silicon is a good enough approximation https://www.wolframalpha.com/input?i=density+of+silicon https://www.wolframalpha.com/input?i=density+of+silicon
- solardev 3y agoThose heat sinks though...
- jerjerjer 3y agoI count only the silicon die.
- slashdev 3y agoPardon me for the stupid question, but wouldn’t you get much better bang for the buck with high end consumer GPUs from Nvidia? I think you’d be limited to 16gb memory per card, but you could have a full 8 card system for less than the price of one H100. Is there really no way to partition the workload to run with 16gb memory per card?
- chrisandchris 3y agoThere's some EUA that prohibts you from using consumer-grade GPUs in server or renting them (can't remember the exact rule, but for sure it's not allowed for Amazon or others to use them).
- Scaevolus 3y agoYou can't legally use their drivers, particularly CUDA, for consumer gear in a datacenter.
- jacquesm 3y agoHas that clause ever been tested? You'd say this is against the doctrine of first sale. https://www.justice.gov/archives/jm/criminal-resource-manual-1854-copyright-infringement-first-sale-doctrine https://www.justice.gov/archives/jm/criminal-resource-manual...
- slashdev 3y agoCould you use them for your own purposes? Not to rent/resell? At that price differential, on premises might make much more sense, provided you have decent utilization. Your breakeven is likely well under 10%.
- latchkey 3y agohttps://www.nvidia.com/en-us/drivers/geforce-license/ https://www.nvidia.com/en-us/drivers/geforce-license/ "No Datacenter Deployment. The SOFTWARE is not licensed for datacenter deployment, except that blockchain processing in a datacenter is permitted."
- pineapple_guy 3y agoAnd they are simply unable to reliably release Linux drivers
- m00x 3y agoLinux graphics you mean? The compute ones are fine. It's not as much of an issue about supporting old versions, it's just that new versions of Linux breaks the drivers since they don't know what's in it.
- redox99 3y agoAlmost 100% of their datacenter GPUs are used on Linux. Do do think they run without drivers?
- michaelt 3y agoThey run with drivers, of course. But such servers have no need to, for example, suspend and resume correctly. Or handle hot-plugging of displays correctly. Or install updates in a completely reliable manner. Or include the 32 bit support needed for Steam to work.
- alecco 3y agoOr support Wayland.
- sieabahlpark 3y ago[dead]
- heroprotagonist 3y agoThat driver also costs $450 per GPU per year.. Source: https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/solutions/resources/documents1/Virtual-GPU-Packaging-and-Licensing-Guide.pdf https://www.nvidia.com/content/dam/en-zz/Solutions/design-vi...
- MenhirMike 3y ago> unable Correction: unwilling, not unable
- varelse 3y ago[dead]