3 ms·
FP8 provides some nice accuracy benefits over INT8 but if you swap it out that doesn't affect your overhead.
by Dylan16807 4y ago
FP8 provides some nice accuracy benefits over INT8 but if you swap it out that doesn't affect your overhead.
3 ms·