3 ms·
These models are huge. I assume they are not quantized down to 4bits yet.
by bhouston 4y ago
These models are huge. I assume they are not quantized down to 4bits yet.
- brucethemoose2 4y agoQuantized versions will pop up on huggingface very soon, if they arent already there. It takes basically no time, much less than something like a alpaca finetune.