5 ms·
this looks very awesome. can someone tell me why there is no chatter about this? is there something else out there that blows this out of the water in terms o
by thedatamonger 2y ago
this looks very awesome. can someone tell me why there is no chatter about this? is there something else out there that blows this out of the water in terms of ease of use and access to sample many LLM's ?
- perrygeo 2y agoOpposite reaction here. I was just thinking, man I hear about Ollama every single day on HN. Not sure a point release is news :-)
- throw03172019 2y agoLola a has been brought up many times on HN. It’s a great tool!
- chadsix 2y agoOllama is really organized - it relies on llama but the UX and organization it provides makes it legit. We recently made a one-click wizard to run Open WebUI and Ollama together, self hosted and remotely accessible but locally hosted [1] [1] https://github.com/ipv6rslimited/cloudseeder https://github.com/ipv6rslimited/cloudseeder
- FieryTransition 2y agoI use a mix of using llamacpp directly via my own python bindings and using it via llamacpp-python for function calling and full control over parameters and loading, but otherwise ollama is just great for ease of use. There's really not a reason not to use it, if just want to load gguf models and don't have any intricate requirements.
- brrrrrm 2y agoHN isnt really the best space for LLM news - r/LocalLlama and twitter are much better. I think HN has some cultural issues with “AI” news
- wkat4242 2y agoHmm I don't think so. Most comments are pretty positive. I think the articles are just not really upvoted unless it's really big news, makes sense because HN is for more than just AI. But I don't think it's anti-AI like most people here would be pretty anti-cryptocurrency (and for good reason IMO)
- p1esk 2y agoI didn’t upvote it because I don’t use Ollama. To experiment with LLMs I use Huggingface. Does Ollama provide something I cannot get with Huggingface?
- gertop 2y agoHugging face is a model repository. Ollama allows you to run those models. Different things.
- p1esk 2y agoI run models using HF just fine. I mean I’m using HF transformers repo, which gets models from HF hub. Or do you mean commercial deployment of models for inference?
- simonw 2y agoAre you talking about the Hugging Face Python libraries, the Hugging Face hosted inference APIs, the Hugging Face web interfaces, the Hugging Face iPhone app, Hugging Face Spaces (hosted Docker environments with GPU access) or something else?
- p1esk 2y agoI updated my comment above: I’m using HF transformers repo, which gets models from HF hub.
- CharlesW 2y agoI can recommend LM Studio and Msty if you're looking for something with an integrated UX.
- gertop 2y agoLM Studio is a lot more user friendly, probably the easiest UI to use out there. No terminal nonsense, no manual to read. Just double click and chat. It even explains to you what the model names mean (eg diff between Q4_1 Q4_K Q4_K_M... For whatever reason all the other tools assume you know what it means). Built-in model recommendations are also handy. Very friendly tool! However it's not open-source.
- Cheer2171 2y agoWhy do you think there is no chatter about this? There have been hundreds of posts about ollama on HN. This is a point release of an already well known project.