3 ms·This is similar to exllamav2, and exllamav2's quantization is also excellent.by brucethemoose2 3y agoThis is similar to exllamav2, and exllamav2's quantization is also excellent.