3 ms·
Elsewhere in the thread, it sounds like your needs a little more robust. But for anyone reading who might be interested: - Tesla K40 12GB cards are ~$130 on U
by matthew-wegner 7y ago
Elsewhere in the thread, it sounds like your needs a little more robust. But for anyone reading who might be interested:
- Tesla K40 12GB cards are ~$130 on US eBay, and have been for awhile
- These cards are passive, though, intending to be used in wind tunnel servers
- However, you can put on 40mm screamer fans to cool them in a normal desktop. Something like https://www.thingiverse.com/thing:3032044 https://www.thingiverse.com/thing:3032044 or just wire-tie to the back grill
High pressure 40mm fans are LOUD, though. I run a desktop with two K40s in my garage, and I can hear it a tiny bit standing outside in my driveway. (I mostly use that box for neural net art experiments like various style transfer workflows)
- bitL 7y agoK80 are for ~$400, 24GB, 2xGPU, newer architecture, a bit better choice.
- pbhjpbhj 7y agoYou consider $400 'low cost'?
- Johnny555 7y agoThe article link mentions an NVIDEO card, and an NVIDIA GeForce GTX 1080 8GB sells for ~ $750 new. I don't know how this $400 card compares for this use case, but it is relatively cheap.
- bitL 7y agoK80 is about as fast as 1080 in FP32 (8.2 vs 8.8TFlops) but vastly faster in FP64 (2.7 vs 0.28TFlops; FP64 supercomputers are still being built with it). It has also 3x the memory, so fitting BERT_large NLP model might be possible. 1080 is pretty much outdated at this point as not many state-of-art models can fit inside 8GB. Disadvantage of K80 are older CUDA kernels versions so customized kernels for new CUDA versions might not work, but most models don't touch CUDA directly anyway.
- pixelwhale 7y agoBeing a dual-GPU model, it really can only fit half the total memory in the majority of cases, because sharing memory across GPUs is far slower and more difficult to implement.
- matthew-wegner 7y agoIt shows up to the OS as two 12GB cards still. So it kind of depends on whether the higher cost is worth the extra slot (in my case it isn't). Total power is less than 2X on the card versus one K40, although I'm not sure offhand if that indicates less performance or just power savings from shared components. As mentioned in a peer comment, K40 aren't the fastest cards either, but the 12GB is really nice for some use cases.
- bitL 7y agoI have one K40 as well; you should be fine, even Haas F1 team built a CFD supercomputer full of them fairly recently ;-) Kepler is pretty good in FP64.