7 ms·
Looks like a big pivot on target audience from developers to regular users, at least on the homepage https://ollama.com/ https://ollama.com/ as a product. Befor
by pentagrama 1y ago
Looks like a big pivot on target audience from developers to regular users, at least on the homepage https://ollama.com/ https://ollama.com/ as a product. Before, it was all about the CLI versions of Ollama for devs, now it's not even mentioned. At the bottom of the blog post it says:
> For pure CLI versions of Ollama, standalone downloads are available on Ollama’s GitHub releases page.
Nothing against that, just an observation.
Previously I tested several local LLM apps, and the 2 best ones to me were LM Studio [1] and Msty [2]. Will check this one out for sure.
One missing feature that the ChatGPT desktop app has and I think is a good idea for these local LLM apps is a shortcut to open a new chat anytime (Alt + Space), with a reduced UI. It is great for quick questions.
[1] https://lmstudio.ai/ https://lmstudio.ai/
[2] https://msty.app/ https://msty.app/
- apitman 1y agoIs there a way to get LM Studio to talk to remote OpenAI API servers and cloud providers?
- HumanOstrich 1y agoLM Studio is for hosting/serving local LLMs. Its chat UI is secondary and is pretty limited.
- apitman 1y agoGood to know, thanks. What do people generally use to connect to it for chat?
- antimius 1y agoMsty (msty.app). Currently they're working on Msty Studio which is only accessible to people with a license, but the desktop app is pretty good, it just doesn't have tool (MCP) support.
- apitman 1y agoDoesn't Msty alreayd run models? What is LM Studio needed for in this setup?
- evgen 1y agoOpenWebUI seems to be the standard. Easy to spin it up in a docker container pointed to 127.0.0.1:1234/v1 and away you go.
- pmarreck 1y agoIf you have a Mac, I recommend https://boltai.com/ https://boltai.com/ for that
- mchiang 1y agoone of the maintainers for Ollama. I don't see it as a pivot. We are all developers ourselves, and we use it. In fact, there are many self-made prototypes before this from different individuals. We were hooked, so we built it for ourselves. Ollama is made for developers, and our focus in continually improving Ollama's capabilities.
- pmarreck 1y agodo you know why ollama hasn't updated its models in over a month while many fantastic models have been released in that time, most recently GLM 4.5? It's forcing me to use LM Studio which I for whatever reason absolutely do not prefer. thank you guys for all your work on it, regardless
- fouc 1y agojust so you know, you can grab any gguf from huggingface and specify the quant like this: ollama pull hf.co/bartowski/nvidia_OpenCodeReasoning-Nemotron-7B-GGUF:IQ4_XS
- _boffin_ 1y agoYou know that if you go to hugging face and find a gguf page, you can click on Deploy and select ollama. It comes with “run” but whatever—just change to pull. Has a jacked name, but works. Also, if you search on ollama’s models, you’ll see user ones that you can download too
- mchiang 1y agoWe work closely with majority of research labs / model creates directly. Most of the times we will support models on release day. There are sometimes where the release window for major models are fairly close - and we just have to elect to support models where we believe will better support a majority of users. Nothing out of spite, and purely limited by the amount of effort required to support these models. We are hopeful too -- where users can technically add models to Ollama directly. Although there is definitely some learning curve.
- 1y ago
- AnonC 1y agoI’d heard of Msty and briefly tried it before. I checked the website again and it looks quite feature rich. I hadn’t known about LM Studio, and I see that it allows commercial use for free (which Matt doesn’t). How would you compare and contrast between the two? My main use would be to use it as a tool with a chat interface rather than developing applications that talk to models.
- Agentlien 1y agoI use Msty all the time and I love it. It just works and it's got all features I want now, including generating alternate responses, swapping models mid-chat, editing both sent messages and responses, ... I also tried LM Studio a few months back. The interface felt overly complex and I got weird error messages which made it look like I'd have to manually fix errors in the underlying python environment. Would have been fine if it was for work, but I just wanted to play around with LLMs in my spare time so I couldn't be bothered.
- hn8726 1y agoLM studio just changed their terms to allow commercial usage for free and without any restrictions or additional actions required. I've used Msty but it seems like LM studio is moving faster, which is kind of important in this space. For example Msty still doesn't support MCP
- pzo 1y agothis is actually positive even for devs. The more users have ollama installed then you can release some desktop ai app for them and don't have to bundle additional models in your own app. Easier to provide to such user free or cheaper subscription because you don't have additional costs. Latest Qwen30B models area really powerful. Would be even better if there was a installation template that checks if Ollama is installed and if not download it as sub installation first checking user computer specs if enough RAM and fast enough CPU/GPU. Also API to prompt user (ask for permission) to install specific model if haven't been installed.
- nocommandline 1y ago> Would be even better if there was a installation template that checks if Ollama is installed and if not download it as sub installation first..... Also API to prompt user (ask for permission) to install specific model if haven't been installed. That's actually what we've done for our own App [1]. It checks if Ollama and other dependencies are installed. No model is bundled with it. We prompt user to install a model (you pick a model, click a button and we download the model; similar if you wish to remove a model). The aim is to make it quite simple for non-technical folks to use. 1) https://ai.nocommandline.com/ https://ai.nocommandline.com/
- trilogix 1y agoThat feature is available in HugstonOne with a new tab, among other features :) Edit: Is incredible how unethical are all the other developers with their crappie spam unrelated. Ollama is a great app and pioneer of AI, cudos and my best thanks.
- mlukaszek 1y agoHave you seen https://pygpt.net/ https://pygpt.net/ ? Overloaded interface and little unfortunate name aside, this seems to be the best one I tried.
- xdennis 1y ago> little unfortunate name aside What's wrong with the name? Are you referring to the GPT trademark? That was rejected.
- mlukaszek 1y agoI may be too picky, and on reflection I probably shouldn't be - it was just my first thought when I saw what the project actually is for the first time. What I meant is the "Py" prefix is typically used for Python APIs/libraries, or Python bindings to libraries in other languages. Sometimes as a prefix for dev tool names like PyInstaller or PyEnv. It's just less often used for standalone apps, only to indicate the project was developed in Python.
- rubymamis 1y ago> One missing feature that the ChatGPT desktop app has and I think is a good idea for these local LLM apps is a shortcut to open a new chat anytime (Alt + Space), with a reduced UI. It is great for quick questions. This is exactly what I've implemented for my Qt C++ app: https://www.get-vox.com https://www.get-vox.com
- halifaxbeard 1y agoThis makes me really wonder about the relationship between Open WebUI & Ollama
- prophesi 1y agoI think having a bash script as the linux installation is more of a stop-gap measure than truly supporting Linux. And ollama is FOSS compared to LM Studio and Msty (as someone who switched from ollama to LM Studio; I'm very happy to see the frontend development of ollama and an easier method of increasing the context length of a model).
- kanestreet 1y agolol the Ollama app is closed source
- prophesi 1y agoOof well there goes my desire to switch back.
- deleted 1y ago[deleted]