11 ms·
No quantization? There’s a lot of optimization being given. Left on the table by doing float math at inference time.
by dontreact 9y ago
No quantization? There’s a lot of optimization being given. Left on the table by doing float math at inference time.