3 ms·
I assumed lmstudio is the obvious choice after ollama. Is there a reason lmstudio is not used widely ?
by bicepjai 4mo ago
I assumed lmstudio is the obvious choice after ollama. Is there a reason lmstudio is not used widely ?
- stingraycharles 4mo agoYeah I’ve also been using it on macOS, my experience is that it works better with the metal API and has better performance.
- dofm 4mo agoLM Studio is fine. Gorgeous actually. I've found it really helpful for understanding parameters, settings, general figuring out. But there is an incentive not to use it if you want to write an article that uses only open-source tools, because it isn't.
- krzyk 4mo agoWhy would anyone use Ollama at all (aside from obvious reasons one can look up online) - llama.cpp used directly, without this wrapper is faster. Basically one has two real choices for local LLMs: llama.cpp (if single user) or vLLM (if multi-user/enterprise).