4 ms·
The cheapest way to get a 80gig setup is to to only offload some layers to GPU, and use CPU/system RAM for the rest. I run ~120GB models on my PC with a 7950X,
by dannyw 3y ago
The cheapest way to get a 80gig setup is to to only offload some layers to GPU, and use CPU/system RAM for the rest.
I run ~120GB models on my PC with a 7950X, 128GB DDR5, and RTX 3090.
- Lerc 3y agoHow much did that cost you? Looking at my local store a rtx 3090 alone costs 25x the cost of an 8gig PI 5