3 ms·
I've run LLaMA 65B 4bit int using llama.cpp on an couple of year old laptop with 64GB of RAM. Not a bunch of extra left, but it does fit!
by miloignis 3y ago
I've run LLaMA 65B 4bit int using llama.cpp on an couple of year old laptop with 64GB of RAM. Not a bunch of extra left, but it does fit!