4 ms·

I haven't seen any repos or guides to using llama on that level of RAM, which is something I do have. any pointers?

• sjy 3y ago
  Run text-generation-webui with llama.cpp: https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui
• kiratp 3y ago
  And here are the benchmarks https://github.com/ggerganov/llama.cpp/issues/34 https://github.com/ggerganov/llama.cpp/issues/34