4 ms·
Llama.cpp has an interactive mode, but I don't think text-generation-webui uses it. https://github.com/ggerganov/llama.cpp/blob/master/examples/main/README.md#i
by sp332 3y ago
Llama.cpp has an interactive mode, but I don't think text-generation-webui uses it. https://github.com/ggerganov/llama.cpp/blob/master/examples/main/README.md#interaction https://github.com/ggerganov/llama.cpp/blob/master/examples/...