3 ms·Yes, but I think it's standard to do inference at q8, not fp16.by cjbprime 2y agoYes, but I think it's standard to do inference at q8, not fp16.