3 ms·
Anyone know of a 65B instruct model I can run on llama.cpp? Or if it’s possible to train one on a 64gb Mac Studio? Haven’t come across either yet.
by bestcoder69 4y ago
Anyone know of a 65B instruct model I can run on llama.cpp? Or if it’s possible to train one on a 64gb Mac Studio? Haven’t come across either yet.
- sahil_chaudhary 4y agoI'm training a 65B model right now, also I believe you can use lora-alpaca to train on this data on a much smaller machine.
- cfn 4y agoLlama has a 65B model and it runs (albeit slowly) on a 64gb Mac Studio with llama.cpp.
- bestcoder69 4y agoYea I have that running. Looking specifically for a 65B instruction-tuned model. I just found a way to get alpaca 30B going though.