3 ms·
This app could use some simple UI improvements: - The chatbox field has a normal "write here" state, when no chat is really selected. I thought my keyboard bro
by eurekin 3y ago
This app could use some simple UI improvements:
- The chatbox field has a normal "write here" state, when no chat is really selected. I thought my keyboard broke until I discovered that
- I didn't find a way to set cuda acceleration before loading a model, only managed to set gpu offloaded layers and using "relaunch to apply"
- Some HugginFace models are simply not listed and there's no indication about why. I guess models are really curated, but somehow presented as a HuggingFace browser?
- Scrolling in the accordion parts of the interface seems to be responding to mouse wheel scroll only. I have a mouse with a damaged one and couldn't find a way to reliably navigate to bottom drawers
That said, I really liked the server tab, which allowed for initial debugging very easily
- easygenes 3y agoIt’s basically a front end for llama.cpp, so it will only show models with GGUF quantizations.
- eurekin 3y agoAh, makes sense
- hahn-kev 3y agoThose are really weird bugs, how do you even manage that these days
- eurekin 3y agoNot sure if sarcastic or not. Assuming not. I did find it quite useful for opening a socket for remote tooling (played around withe the continue plugin). The quirky UI did slow me down,but nothing really showstopping