4 ms·
Llama has a 65B model and it runs (albeit slowly) on a 64gb Mac Studio with llama.cpp.
by cfn 4y ago
Llama has a 65B model and it runs (albeit slowly) on a 64gb Mac Studio with llama.cpp.
- bestcoder69 4y agoYea I have that running. Looking specifically for a 65B instruction-tuned model. I just found a way to get alpaca 30B going though.