3 ms·
People have been running LLaMA in 4bit quickly on cheap hardware with a simple GUI for over a week using https://github.com/oobabooga/text-generation-webui http
by MacsHeadroom 4y ago
People have been running LLaMA in 4bit quickly on cheap hardware with a simple GUI for over a week using https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui
Just not on Macs. (that repo does not support Apple Silicon)