3 ms·
I think it’s using 4 bit quantized model (32MB - 46MB). See table 5 https://browser.mt/assets/D5.1.pdf https://browser.mt/assets/D5.1.pdf
by febed 3y ago
I think it’s using 4 bit quantized model (32MB - 46MB). See table 5 https://browser.mt/assets/D5.1.pdf https://browser.mt/assets/D5.1.pdf