3 ms·
Related question: what is everyone using to run a local LLM? I'm using Jan.ai and it's been okay. I also see OpenWebUI mentioned quite often.
by nosecreek 1y ago
Related question: what is everyone using to run a local LLM? I'm using Jan.ai and it's been okay. I also see OpenWebUI mentioned quite often.
- op00to 1y agoLMStudio, and sometimes AnythingLLM.
- Havoc 1y agoLM studio if you just want an app. openwebui is just a front end - you'd need to have either llama.cpp or vllm behind it to serve the model
- fennecfoxy 1y agoKoboldCPP + SillyTavern, has worked the best for me.