4 ms·
Don't get too excited about V100. P100 was announced over 1 year ago and is still today not available from AWS, GCE, or Azure (despite various announcements). A
by modeless 9y ago
Don't get too excited about V100. P100 was announced over 1 year ago and is still today not available from AWS, GCE, or Azure (despite various announcements). Although you can now, finally, order one at retail for the low, low price of $12k+ [1] [2].
The upcoming Volta-based consumer GPUs are going to be your best value for machine learning, not V100.
[1] https://www.amazon.com/NVIDIA-Tesla-P100-computing-processor/dp/B06WV7HFWV/ https://www.amazon.com/NVIDIA-Tesla-P100-computing-processor...
[2] http://accessories.us.dell.com/sna/productdetail.aspx?c=us&l=en&s=bsd&cs=04&sku=489-BBCF&cid=298721&st=&VEN1=saalXTMnP%2C101952148149%2C901q5c14135%2Cc%2C%2C489-BBCF&VEN2=%2C&lid=5704670&dgc=ST&DGSeg=SO&acd=12309152537501410&VEN3=105703622544116288 http://accessories.us.dell.com/sna/productdetail.aspx?c=us&l...
- jamesfmilne 9y agoYou can get the Quadro GP100, which is pretty much identical (I've got 2). http://images.nvidia.com/content/pdf/quadro/data-sheets/302049-NV-DS-Quadro-Pascal-GP100-US-NV-27Feb17-HR.pdf http://images.nvidia.com/content/pdf/quadro/data-sheets/3020... Agreed re consumer GPUs for machine learning though.
- modeless 9y agoInteresting, I hadn't heard of GP100, only released in February. Still, at $6000, as expensive as eight 1080 Tis.
- tanderson92 9y agoYeah but the double precision on the 1080 TIs is crippled, so the eight 1080 TIs would (in theory) be 50% as powerful in FP64 performance of a single Quadro GP100. There are good reasons to use the higher end chips, in some cases (maybe not for ML).
- endorphone 9y agoMany of the early P100s went to supercomputers. The V100 is interesting because they implemented "tensor cores", and claim that it will offer 12 times the deep learning performance of the already class leading P100. I'm not sure how consumer GPUs that don't exist can be better, though. That seems highly presumptive, especially given that most machine learning setups are heat, cooling and space limited.
- modeless 9y ago> most machine learning setups are heat, cooling and space limited. You forgot "cost". V100, like P100, will cost literally more than 10 times what consumer cards do, for a likely speedup of less than 2 times. For the vast majority of people, that will not be worth it.
- endorphone 9y agoThe 1080Ti you mentioned elsewhere achieves about 1/60th the performance of FP16 deep learning that the P100 does. The V100 would increase that gap by another magnitude. And on the other end, FP64, it has as a similar deficiency. Of course eventually maybe they'll come out with a cheap but powerful deep learning GPU (though with the V100 having a 800mm2 die, inexpensive is going to be relative), and it's impossible for me to compare with future products, but there's a good reason these cost as much as they do.
- modeless 9y agoWhere did you get those numbers? For deep learning P100 is ~ 2x faster than 1080 Ti (optimistically). 60x is just ludicrously wrong. The gap between V100 and 1180 is yet to be determined and depends mostly on what Nvidia does with the tensor units. We shall see. But I am extremely confident in saying that the performance gap will be nowhere near 60x, let alone higher than that. And despite the early announcement of V100, 1180 is likely to be available to most people long before V100, just like P100 and 1080 before.
- endorphone 9y ago60x is just ludicrously wrong. I said that FP16 performance is at least 60x worse, which it absolutely is. The cores on the GT102 do not natively support FP16, so each FP16 operand has to be converted to FP32 and then processed, with significant overhead. The P100 can use FP16 directly yielding not only double the processing speed (because the FP32 cores are really dual FP16 cores, like registers on an x86), but a major memory savings. The 1080(Ti) is crippled at FP64 as well, again dramatically slower than the P100. It's a consumer GPU and FP16 and FP64 just aren't usually a consumer need. These aren't just the same thing, with one having a sucker price. They are dramatically different chips, and many applications require the P100. just like P100 and 1080 before. Comparing the P100 and 1080Ti as if the latter is the consumer version of the former is not useful. They are profoundly different chips.