5 ms·
Both GPUs support both formats, so comparing an 8 bit quantized model on one to a 16 bit model on another is nonsense. That'll massively affect the result.
by andersa 3y ago
Both GPUs support both formats, so comparing an 8 bit quantized model on one to a 16 bit model on another is nonsense. That'll massively affect the result.