4 ms·
Orthogonal, but I just wanted to say how awesome Ollama is. It took 2 seconds to find the model and a minute to download and now I'm using it. Kudos to that t
by timmg 1y ago
Orthogonal, but I just wanted to say how awesome Ollama is. It took 2 seconds to find the model and a minute to download and now I'm using it.
Kudos to that team.
- _ache_ 1y agoTo be fair, it's with the help of OpenAI. They did it together, before the official release. https://ollama.com/blog/gpt-oss https://ollama.com/blog/gpt-oss
- aubanel 1y agoFrom experience, it's much more engineering work on the integrator's side than on OpenAI's. Basically they provide you their new model in advance, but they don't know the specifics of your system, so it's normal that you do most of the work. Thus I'm particularly impressed by Cerebras: they only have a few models supported for their extreme perf inference, it must have been huge bespoke work to integrate.
- Shopper0552 1y agoI remember reading Ollama is going closed source now? https://www.reddit.com/r/LocalLLaMA/comments/1meeyee/ollamas_new_gui_is_closed_source/ https://www.reddit.com/r/LocalLLaMA/comments/1meeyee/ollamas...
- int_19h 1y agoIt's just as easy with LM Studio. All the real heavy lifting is done by llama.cpp, and for the distribution, by HuggingFace.