3 ms·
right now, we support AWQ but are currently working on various quantization methods in https://github.com/trymirai/lalamo https://github.com/trymirai/lalamo
by AlekseiSavin 1y ago
right now, we support AWQ but are currently working on various quantization methods in https://github.com/trymirai/lalamo https://github.com/trymirai/lalamo