3 ms·13B fits on a single 3090 (24GB) in int8. 128 gigs might even be enough for 65B, if slowly.by MacsHeadroom 4y ago13B fits on a single 3090 (24GB) in int8. 128 gigs might even be enough for 65B, if slowly.