4 ms·
I have a similarly old desktop with 24GB RAM and outdated GPU. What sort of token/second were you able to get with the 7B models?
by vin047 3y ago
I have a similarly old desktop with 24GB RAM and outdated GPU. What sort of token/second were you able to get with the 7B models?