4 ms·
See the chart titled: Performance in images per second per $. TPUv2 is has 1.27x-1.86x the images/s/$. And the other chart titled: Cost to reach 75.7% top-1 a
by ndesaulniers 9y ago
See the chart titled: Performance in images per second per $.
TPUv2 is has 1.27x-1.86x the images/s/$.
And the other chart titled: Cost to reach 75.7% top-1 accuracy.
Where TPUv2 costs 62.5% the reserved GPU instance and 42.6% the unreserved GPU cost.
Key takeaway from the article:
> While the V100s perform similarly fast, the higher price and slower convergence of the implementation results in a considerably higher cost-to-solution.