3 ms·
nope. I am self-hosting. support is pretty good actually. llama.cpp supports it (v1.6 too; and in openai API server as well). ollama supports it. open-web-ui ch
by nikolayasdf123 2y ago
nope. I am self-hosting. support is pretty good actually. llama.cpp supports it (v1.6 too; and in openai API server as well). ollama supports it. open-web-ui chat too.
using it now on desktop (I am in China, so no OpenAI here) and in cloud cluster on project.