3 ms·
M2 MacBook has 96GB at 14". One can use it to run LLaMA 4-bit instead of 3-bit.
by bitL 3y ago
M2 MacBook has 96GB at 14". One can use it to run LLaMA 4-bit instead of 3-bit.
- miloignis 3y agoI've run LLaMA 65B 4bit int using llama.cpp on an couple of year old laptop with 64GB of RAM. Not a bunch of extra left, but it does fit!