5 ms·

If anyone is looking for a nice Chat UI on top of Ollama that supports both online models and local models, I’ve been working on an app [1] that is offline and

by chown 3y ago

If anyone is looking for a nice Chat UI on top of Ollama that supports both online models and local models, I’ve been working on an app [1] that is offline and privacy focused. I just released Windows support this morning. [1]: https://msty.app https://msty.app

haliskerbas 3y ago
Off topic but what did you use to make your landing page?
- chown 3y ago
  It’s a Nuxt static app but all hand rolled, no builder or anything like that if that’s what you are asking.
  - haliskerbas 3y ago
    That's what I was looking for, I couldn't find any elements or class names that I recognized in the code from the popular frameworks. Looks great!
    - chown 3y ago
      Thank you! I probably spent way too much time tweaking it. Haha! I am glad someone liked all the small details I was sweating on.
      - user_7832 3y ago
        Chiming in to say the page looks really good and professional! It’s definitely “enterprise level” in a good way, I was initially searching for a “pricing” tab lol. Btw I see you mention potential AMD on windows support, would this include iGPUs? I’d love to use your app on my ryzen 7 laptop on its 780m. Thanks!
        chown 3y ago
        Thank you! I am still exploring supporting Msty on AMD GPUs and it's on the top of my list. i even bought an AMD laptop yesterday for testing. Please keep an eye on our changelog (or better, on our Discord) for when we announce AMD support.
        user_7832 3y ago
        Thanks, I will!
vorticalbox 3y ago
Any plans for a Linux client?
- chown 3y ago
  Yes. I already have a local build that I am testing. Going to release it in a week or so.
vdaea 3y ago
I'm trying the Windows version. What really sticks out is that buttons don't have tooltips. It's impossible to know what they do if you don't click them. Also in the conversation view you have two buttons "New Chat" and "Add Chat" which do two different things but they both have the same keybind ^T
- chown 3y ago
  Thanks for the feedback. I will get them resolved soon.
  - wlesieutre 3y ago
    I'm getting a lot of jank with the hovery-sidebar: https://imgur.com/a/VXZXL94 https://imgur.com/a/VXZXL94 Personally I'd rather have the sidebar be toggled on click, instead of having such a huge animation every time my mouse passes by. And if it's such an important part of the UI that requiring a click is too much of a barrier, then it'd be better to build that functionality into a permanent sidebar rather than a buried under a level of sidebar buttons. The sidebar on my Finder windows for example are about 150px wide, always visible, and fit more content than all three of Msty's interchanging sidebars put together. If I had a lot of previous conversations that might not be true anymore, but a single level sidebar with subheadings still works fine for things like Music where I can have a long list of playlists. If it's too many conversations to reasonably include in an always visible list then maybe they go into a [More] section. Current UI feels like I had to think a bit too much to understand how it's organized.
    - chown 3y ago
      Ugh! That’s not the experience I wanted people to have. Sorry about that and I will be working on making the experience better. Feedback like yours really helps so thank you very much.
attentive 3y ago
adding gemini API?
- chown 3y ago
  Yes. I signed up for the API a couple of days ago and I am in the waitlist.
  - attentive 3y ago
    gemini-pro is available without a wait list. Go to AI studio to get a key.
    - BOOSTERHIDROGEN 3y ago
      Wait how to get that ? I just submit email on waitlist
      - attentive 3y ago
        waitlist is for ultra or 1.5, whatever, 1.0 pro is available aistudio.google.com
attentive 3y ago
btw, it triggers Program:Win32/Wacapew.C!ml detection
- chown 3y ago
  Hmmm… it’s a false positive. Is it Windows Defender or something else? Is it when you open the app or when you setup local AI? Not sure where I would send a request for it to be not flagged.
  - js4ever 3y ago
    It's probably an issue with the tool you used to create the installer. Few options: use another tool like the one included in visual studio, sign your exe with a certificate. Or publish it on the windows marketplace. Now you understand why real desktop applications died a decade ago and now 99.99% of apps are using a web UI
    - chown 3y ago
      That’s true and unfortunate. The MacOS installer is signed and I will be looking into signing the Windows installer. Thank you for your suggestions. My last experience of getting and signing a Windows installer was awful and goes back to what you were saying about desktop app dying a decade ago.
    - dom96 3y ago
      I'd say it's more an issue with the anti-virus that is flagging this as a virus when it isn't one. We should expect better out of AV software. I've personally seen many instances of false positives across various software that was definitely not a virus.
      - rezonant 3y ago
        There seems to be something about what these AI apps do that causes the false positives, because Ollama itself also triggers Windows defender https://github.com/ollama/ollama/issues/2519 https://github.com/ollama/ollama/issues/2519
sumedh 3y ago
Is this similar to LLM Studio?

by chown 3y ago

haliskerbas 3y ago

Off topic but what did you use to make your landing page?

chown 3y ago
It’s a Nuxt static app but all hand rolled, no builder or anything like that if that’s what you are asking.
- haliskerbas 3y ago
  That's what I was looking for, I couldn't find any elements or class names that I recognized in the code from the popular frameworks. Looks great!
  - chown 3y ago
    Thank you! I probably spent way too much time tweaking it. Haha! I am glad someone liked all the small details I was sweating on.
    - user_7832 3y ago
      Chiming in to say the page looks really good and professional! It’s definitely “enterprise level” in a good way, I was initially searching for a “pricing” tab lol. Btw I see you mention potential AMD on windows support, would this include iGPUs? I’d love to use your app on my ryzen 7 laptop on its 780m. Thanks!
      - chown 3y ago
        Thank you! I am still exploring supporting Msty on AMD GPUs and it's on the top of my list. i even bought an AMD laptop yesterday for testing. Please keep an eye on our changelog (or better, on our Discord) for when we announce AMD support.
        user_7832 3y ago
        Thanks, I will!

vorticalbox 3y ago

Any plans for a Linux client?

chown 3y ago
Yes. I already have a local build that I am testing. Going to release it in a week or so.

vdaea 3y ago

I'm trying the Windows version. What really sticks out is that buttons don't have tooltips. It's impossible to know what they do if you don't click them. Also in the conversation view you have two buttons "New Chat" and "Add Chat" which do two different things but they both have the same keybind ^T

chown 3y ago
Thanks for the feedback. I will get them resolved soon.
- wlesieutre 3y ago
  I'm getting a lot of jank with the hovery-sidebar: https://imgur.com/a/VXZXL94 https://imgur.com/a/VXZXL94 Personally I'd rather have the sidebar be toggled on click, instead of having such a huge animation every time my mouse passes by. And if it's such an important part of the UI that requiring a click is too much of a barrier, then it'd be better to build that functionality into a permanent sidebar rather than a buried under a level of sidebar buttons. The sidebar on my Finder windows for example are about 150px wide, always visible, and fit more content than all three of Msty's interchanging sidebars put together. If I had a lot of previous conversations that might not be true anymore, but a single level sidebar with subheadings still works fine for things like Music where I can have a long list of playlists. If it's too many conversations to reasonably include in an always visible list then maybe they go into a [More] section. Current UI feels like I had to think a bit too much to understand how it's organized.
  - chown 3y ago
    Ugh! That’s not the experience I wanted people to have. Sorry about that and I will be working on making the experience better. Feedback like yours really helps so thank you very much.

attentive 3y ago

adding gemini API?

chown 3y ago
Yes. I signed up for the API a couple of days ago and I am in the waitlist.
- attentive 3y ago
  gemini-pro is available without a wait list. Go to AI studio to get a key.
  - BOOSTERHIDROGEN 3y ago
    Wait how to get that ? I just submit email on waitlist
    - attentive 3y ago
      waitlist is for ultra or 1.5, whatever, 1.0 pro is available aistudio.google.com

attentive 3y ago

btw, it triggers Program:Win32/Wacapew.C!ml detection

chown 3y ago
Hmmm… it’s a false positive. Is it Windows Defender or something else? Is it when you open the app or when you setup local AI? Not sure where I would send a request for it to be not flagged.
- js4ever 3y ago
  It's probably an issue with the tool you used to create the installer. Few options: use another tool like the one included in visual studio, sign your exe with a certificate. Or publish it on the windows marketplace. Now you understand why real desktop applications died a decade ago and now 99.99% of apps are using a web UI
  - chown 3y ago
    That’s true and unfortunate. The MacOS installer is signed and I will be looking into signing the Windows installer. Thank you for your suggestions. My last experience of getting and signing a Windows installer was awful and goes back to what you were saying about desktop app dying a decade ago.
  - dom96 3y ago
    I'd say it's more an issue with the anti-virus that is flagging this as a virus when it isn't one. We should expect better out of AV software. I've personally seen many instances of false positives across various software that was definitely not a virus.
    - rezonant 3y ago
      There seems to be something about what these AI apps do that causes the false positives, because Ollama itself also triggers Windows defender https://github.com/ollama/ollama/issues/2519 https://github.com/ollama/ollama/issues/2519

sumedh 3y ago

Is this similar to LLM Studio?