4 ms·
Crazy to see stuff like the H100 at $2.40 per GPU hour. It feels like not that long ago that K80s would cost more than that. Moore's law still seems alive in do
by 6gvONxR4sf7o 3y ago
Crazy to see stuff like the H100 at $2.40 per GPU hour. It feels like not that long ago that K80s would cost more than that. Moore's law still seems alive in dollars per FLOP.
- andrewstuart 3y ago$21,000 per year ouch. That'll buy you about 13 RTX 4090's outright.
- dahart 3y agoWhy aren’t you comparing to the price of buying an H100?
- deleted 3y ago[deleted]
- selectodude 3y agoAn H100 is about $30,000.
- MacsHeadroom 3y agoPlus a year of electricity. $21k/year is a steal.
- raxxorraxor 3y agoOr 2-3 A100. The H100 are allegedly more budget friendly, but I din't find that true on the "black market". And I think it draws a bit less power, but I have absolutely no experience about the software suites NVidia offers. I think the price is quite high to be honest, although probably realistic. Wouldn't expect competitors to be able to offer something better and data centers need to calculate for maybe newer models with even better performance.