4 ms·
Tokens per second is abysmal no matter how much ram you have
by jazzyjackson 8mo ago
Tokens per second is abysmal no matter how much ram you have
- giancarlostoro 8mo agoSome models run worse than others but I have gotten reasonable performance on my M4 Pro with 24 GB of RAM