4 ms·
I prompted bare Llama-30B quantized to 4 bits with a few codes from the KMS activation list, and it generated some more from the list. Smaller ones might work t
by sp332 3y ago
I prompted bare Llama-30B quantized to 4 bits with a few codes from the KMS activation list, and it generated some more from the list. Smaller ones might work too but messed up my files for those and haven't been able to test.