3 ms·It's a RAM tradeoff. If you have enough GPU RAM to load the non-quantized model it may be faster.by api 3y agoIt's a RAM tradeoff. If you have enough GPU RAM to load the non-quantized model it may be faster.