2 ms·Raw model size is around 27x2 GB since it's in BF16 formatby kzrdude 2mo agoRaw model size is around 27x2 GB since it's in BF16 formatmacwhisperer 2mo ago4-bit quant sits at 15.72GB