> FP16 is faster (units are images per second) But does model get quality hit: need to train for more steps before converging to the similar performance and ha

> FP16 is faster (units are images per second) But does model get quality hit: need to train for more steps before converging to the similar performance and have more parameters? FM16 obviously contains less information than FP32.