4 ms·
Titan V in my testing only approached 100+TFlops in purely synthetic large matmuls. With carefully tuned Transformer (matmul-heavy!) I could only make twice as
by dimitry12 8y ago
Titan V in my testing only approached 100+TFlops in purely synthetic large matmuls.
With carefully tuned Transformer (matmul-heavy!) I could only make twice as fast as 1080ti (at 4 times the price).
The only undisputable benefit was using double batch size.