12 ms·
INT8 quantisation has been used in production for years. FP8 has not.
by FL33TW00D 4y ago
INT8 quantisation has been used in production for years.
FP8 has not.
- Dylan16807 4y agoFP8 provides some nice accuracy benefits over INT8 but if you swap it out that doesn't affect your overhead.