2 ms·
So does this beat 8 V100s in a DGX? And if yes what TPU v3-n is it comparable to?
by debbiedowner 6y ago
So does this beat 8 V100s in a DGX? And if yes what TPU v3-n is it comparable to?
- trhway 6y agoby transistor count, by energy consumption and i'd expect by the price it is an equivalent of 3 x 16 V100 DGX/Lambdasystems. Can it beat such a minicluster? Vertical vs. horizontal scaling seems to be still an open question for DL. It looks like the horizontal - ie. V100 approach in this case - would naturally have advantage over the vertical when it comes to sheer scale, i.e. like the maximum possible size of model.