4 ms·24GB can fit 33B parameter models in 4bit. You only need 4GB to run 7B models.by MacsHeadroom 3y ago24GB can fit 33B parameter models in 4bit. You only need 4GB to run 7B models.