3 ms·
Can you expand on why the operations per second is not an apt comparison?
by handfuloflight 2y ago
Can you expand on why the operations per second is not an apt comparison?
- pertymcpert 2y agoWhen you're doing scientific simulations, you're generally a lot more sensitive to FP precision than ML training which is very, very tolerant of reduced precision. So while FP8 might be fine for transformer networks, it would likely be unacceptably inaccurate/unusable for simulations.