5 ms·
Jan – Ollama alternative with local UI
- jwildeboer 1y agoMy name is Jan and I am not an AI thingy. Just FTR. :)
- underlines 1y agoJan here too, and I work with LLMs full time and I'm a speaker about these topics. Annoying how many times people ask me if Jan.ai is me lol
- dsp_person 1y agoWe need a steve.ai
- roscas 1y agoTried to run Jan but it does not start llama server. It also tries to allocate 30gb that is the size of the model but my vram is only 10gb and machine is 32gb, so it does not make sense. Ollama works perfect with 30b models. Another thing that is not good is that it make constant connections to github and other sites.
- hoppp 1y agoIt probably loads the entire model into ram at once while ollama solves this and does not, it has a better loading strategy
- blooalien 1y agoYeah, if I remember correctly, Ollama loads models in "layers" and is capable of putting some layers in GPU RAM and the rest in regular system RAM.
- SilverRubicon 1y agoDid you see the feature list? It does not deny that makes connections to other sites. - Cloud Integration: Connect to OpenAI, Anthropic, Mistral, Groq, and others - Privacy First: Everything runs locally when you want it to
- trilogic 1y ago[flagged]
- imiric 1y agoYou mean this[1]? It's not open source, has no license, runs on Windows only, and requires an activation code to use. Also, the privacy policy on their website is missing[2]. Anyone remotely concerned about privacy wouldn't come near this thing. Ah, you're the author, no wonder you're shilling for it. [1]: https://github.com/Mainframework/HugstonOne https://github.com/Mainframework/HugstonOne [2]: https://hugston.com/privacy https://hugston.com/privacy
- trilogic 1y agoThe app has a licence well visible when you install the app. The rest is written in the website and in github. Then about: requires an activation code to use, ofc it is made for ethical research purposes, so yes I am distributing it responsibly. And you can see the videos in the youtube channel for how it works. But the most important point is that you can try it easily with a firewall to see that it do not leak bytes like all the rest there. That´s what i call privacy, It has a button that cut all connection. You can say what you want but that´s it that´s all.
- azyc 1y ago[dead]
- biinjo 1y agoIm confused. Isn’t the whole premise of Ollama that its locallt ran? What’s the difference or USP when comparing the two.
- moron4hire 1y agoThat's not the actual tagline being used in the repo. The repo calls itself an alternative to ChatGPT. Whoever submitted the link changed it.
- hoppp 1y agoI think its an alternative because ollama has no UI and its hard to use for non-developers who will never touch the CLI
- bogdart 1y agoI tried Jan last year, but the UI was quite buggy. But maybe they fixed it.
- diggan 1y agoPlease do try it out again, if things used to be broken but they no longer are, it's a good signal that they're gaining stability :) And if it's still broken, even better signal that they're not addressing bugs which would be worse.
- mathfailure 1y agoIs this an alternative to OpenWebUI?
- apitman 1y agoNot exactly. OWUI is a server with a web app frontend. Jan is a desktop app you install. But it does have the ability to run a server for other apps like OWUI to talk to.
- ekianjo 1y agoOpenweb-ui does not include a server.
- apitman 1y agoI was referring to Jan.
- cristoperb 1y agoIt starts a webserver to serve its UI, which is what your comment parent meant. It doesn't provide its own openai-style API, which I guess is what you meant.
- PeterStuer 1y agoMore an alternative to LM Studio I think from the description.
- apitman 1y agoJan also supports connecting to remote APIs (like OpenRouter), which I don't think LM Studio does
- semessier 1y agostill looking for vLLM to support Mac ARM Metal GPUs
- baggiponte 1y agoYeah. The docs tell you that you should build it yourself, but…
- tough 1y agobut unlike cuda there's no custom kernels for inference in vllm repo... I think
- apitman 1y agoI really like Jan, especially the organization's principles: https://jan.ai/ https://jan.ai/ Main deal breaker for me when I tried it was I couldn't talk to multiple models at once, even if they were remote models on OpenRouter. If I ask a question in one chat, then switch to another chat and ask a question, it will block until the first one is done. Also Tauri apps feel pretty clunky on Linux for me.
- c-hendricks 1y agoYeah, webkit2gtk is a bit of a drag
- diggan 1y ago> Also Tauri apps feel pretty clunky on Linux for me. All of them, or this one specifically? I've developed a bunch of tiny apps for my own usage (on Linux) with Tauri (maybe largest is just 5-6K LoC) and always felt snappy to me, mostly doing all the data processing with Rust then the UI part with ClojureScript+Reagent.
- _the_inflator 1y agoYep. I really see them as an architecture blueprint with a reference implementation and not so much as a one size fits all app. I stumbled upon Jan.ai a couple of months ago when I was considering a similar app approach. I was curious because Jan.ai went way beyond what I considered to be limitations. I haven’t tried Jan.ai yet, I see it as an implementation not a solution.
- signbcc 1y ago> especially the organization's principles I met the team late last year. They’re based out of Singapore and Vietnam. They ghosted me after promising to have two follow-up meetings, and were unresponsive to any emails, like they just dropped dead. Principles and manifestos are a dime a dozen. It matters if you live by them or just have them as PR pieces. These folks are the latter.
- dcreater 1y agoWith a name like Menlo research, I assumed they were based in Menlo park. They probably intended that
- venkyvb 1y agoHow does this compare to LM studio ?
- rmonvfer 1y agoI use both and Jan is basically the OSS version of LM Studio with some added features (e.g, you can use remote providers) I first used Jan some time ago and didn’t really like it but it has improved a lot so I encourage everyone to try it, it’s a great project
- angelmm 1y agoFor me, the main difference is that LM Studio main app is not OSS. But they are similar in terms of features, although I didn't use LM Studio that much.
- reader9274 1y agoTried to run the gpt-oss:20b in ollama (runs perfectly) and tried to connect ollama to jan but it didn't work.
- thehamkercat 1y agoExactly: https://github.com/menloresearch/jan/issues/5474 https://github.com/menloresearch/jan/issues/5474 Can't make it work with ollama endpoint this seems to be the problem but they're not focusing on it: https://github.com/menloresearch/jan/issues/5474#issuecomment-3006694325 https://github.com/menloresearch/jan/issues/5474#issuecommen...
- accrual 1y agoI got Jan working with Ollama today. Jan reported it couldn't connect to my Ollama instance on the same host despite it working fine for other apps. I captured loopback and noticed Ollama returning an HTTP 403 forbidden message to Jan. The solution was set environment variables: OLLAMA_HOST=0.0.0.0 OLLAMA_ORIGINS=* Here's the rest of the steps: - Jan > Settings > Model Providers - Add new provider called "Ollama" - Set API key to "ollama" and point to http://localhost:11434/v1 - Ensure variables above are set - Click "Refresh" and the models should load Note: Even though an API key is not required for local Ollama, Jan apparently doesn't consider it a valid endpoint unless a key is provided. I set mine to "ollama" and then it allowed me to start a chat.
- deleted 1y ago[deleted]
- klausa 1y agoSo this is how women named Siri felt in 2011.
- lagniappe 1y agoHello Jan ;)