3 ms·
Is there a benchmark you've seen that matches the claimed 10x increase in performance for the Tensor Cores? NVIDIA hype train can sometimes make it difficult to
by sabalaba 8y ago
Is there a benchmark you've seen that matches the claimed 10x increase in performance for the Tensor Cores? NVIDIA hype train can sometimes make it difficult to find hard numbers.
- shaklee3 8y agoI've done my own benchmarks where I've hit over 100 TFLOPS on the V100, and that's about 85% of the peak theoretical throughout of them. Granted the matrix size needs to be large enough, but it's definitely doable. Anandtech also showed similar results in their V100 review. I haven't yet seen a comparable SGEMM done on the 2080Ti, so I don't know how it'll compare. I have some coming in at the end of the month though, so I should know soon.
- dimitry12 8y agoTitan V in my testing only approached 100+TFlops in purely synthetic large matmuls. With carefully tuned Transformer (matmul-heavy!) I could only make twice as fast as 1080ti (at 4 times the price). The only undisputable benefit was using double batch size.