2 ms·With that said, there are ggml/gptq and other optimization techniques.by brianjking 3y agoWith that said, there are ggml/gptq and other optimization techniques.