3 ms·
If you're paying for CPU/GPU hours, the more you parallelize the faster you get your result for the same money. (Of course till you hit the parallelization limi
by euyyn 10y ago
If you're paying for CPU/GPU hours, the more you parallelize the faster you get your result for the same money. (Of course till you hit the parallelization limit of your network, but NNs are very parallelizable in general). And the larger your training dataset, the better your results.
- dragandj 10y agoI am aware of that. The question was not whether more than 8 GPUs would be useful in ideal circumstances, it was about how many people actually use that functionality with other frameworks other than DL4J?
- euyyn 10y agoIt'd be a nice statistic to know. Could be dangerous too, as in the infamous "640 kilobytes should be enough for everyone".