3 ms·
They almost all seem to run at FP16 precision, so they are not quantized, just optimized to run on Qualcomm NPU.
by GaggiX 3y ago
They almost all seem to run at FP16 precision, so they are not quantized, just optimized to run on Qualcomm NPU.
3 ms·