4 ms·
To add to this, I have a laptop with 32G of RAM and am able to run some 7B models on CPU. But I'd like to work on some larger models. Are there any eGPUs that c
by l72 3y ago
To add to this, I have a laptop with 32G of RAM and am able to run some 7B models on CPU. But I'd like to work on some larger models. Are there any eGPUs that can aid in this?
- qingcharles 3y agoI have a 12-year-old desktop with 24GB of RAM and no modern GPU and can run the 7B models, it's just no fun :(
- vin047 3y agoI have a similarly old desktop with 24GB RAM and outdated GPU. What sort of token/second were you able to get with the 7B models?