3 ms·
Better performance than TQ and better quality than FP16? Am I reading this right??
by throwa356262 4mo ago
Better performance than TQ and better quality than FP16?
Am I reading this right??
- pbich 4mo ago[dead]
- thefox96 4mo agoFaster than Fp16, not better quality i guess
- qeternity 4mo agoIt's not better quality: 59.3% vs 59.4% fp16 on AIME 25
- sheepscreek 4mo ago0.1% is within margin of error. Depending on the performance boost, it might be worthwhile taking a minuscule quality hit.
- qeternity 4mo agoI think it very much is worth it! But the point was that quality didn't magically increase.
- electroglyph 4mo agoany divergence (even if the benchmark is better) from full precision is error
- 7e 4mo agoJust pretend that it is the next step update when training. You didn’t train your model to step=inf, I hope?