3 ms·
I have a 12-year-old desktop with 24GB of RAM and no modern GPU and can run the 7B models, it's just no fun :(
by qingcharles 3y ago
I have a 12-year-old desktop with 24GB of RAM and no modern GPU and can run the 7B models, it's just no fun :(
- vin047 3y agoI have a similarly old desktop with 24GB RAM and outdated GPU. What sort of token/second were you able to get with the 7B models?