3 ms·
FP16 is faster (units are images per second)
by smallnamespace 6y ago
FP16 is faster (units are images per second)
- bryan0 6y agoSorry I was referring to the relative performance, I edited my question to be clearer
- riku_iki 6y ago> FP16 is faster (units are images per second) But does model get quality hit: need to train for more steps before converging to the similar performance and have more parameters? FM16 obviously contains less information than FP32.
- bitL 6y ago3090 opted for bundling 2x FP32 units Bulldozer-style and now FP16 is processed by those cores as well, so FP16 and FP32 have the same performance (35.58TFlops). https://www.techpowerup.com/gpu-specs/geforce-rtx-3090.c3622 https://www.techpowerup.com/gpu-specs/geforce-rtx-3090.c3622