4 ms·At 4 bits the 13B LLaMa model can run on a 10GB card!by loufe 4y agoAt 4 bits the 13B LLaMa model can run on a 10GB card!