3 ms·
On an M3 MacBook Pro with 32GB of RAM, I can comfortably run 34B models like phind-codellama:34b-v2-q8_0. Unfortunately, having tried this and a bunch of other
by jwr 3y ago
On an M3 MacBook Pro with 32GB of RAM, I can comfortably run 34B models like phind-codellama:34b-v2-q8_0.
Unfortunately, having tried this and a bunch of other models, they are all toys compared to GPT-4.