4 ms·
Anyone got the 65B model to work with llama.cpp? 7B worked fine for me, but 30B and 65B just output garbage. (On Linux with a 5800X and 64GB of RAM)
by shocks 4y ago
Anyone got the 65B model to work with llama.cpp? 7B worked fine for me, but 30B and 65B just output garbage.
(On Linux with a 5800X and 64GB of RAM)
- BinRoo 4y agoRerun make, and regenerate the quantized files, because some new commits broke backwards compatibility, if you recently pulled.
- shocks 4y agoThanks for the tip. I tried 404fac0, but got: "The search for extraterrestrial life will most likely conclude adv provinß wojewłożGener Wikipédia Świirc Patrickvidcido protectsobDra"