37 ms·I'm using official @8bit quants from Qwen, they maintain more capabilityby verdverm 4mo agoI'm using official @8bit quants from Qwen, they maintain more capability