2 ms·
It's using 4-bit quantized models, so it's kind of like if someone removed half your brain and still expected it to work. Especially since that quantization com
by astrange 3y ago
It's using 4-bit quantized models, so it's kind of like if someone removed half your brain and still expected it to work. Especially since that quantization comes after training, so it doesn't get a chance to "heal" from it.