3 ms·
Is there something similar, but geared towards a Linux desktop / laptop? I suppose this would be relatively easy to adapt.
by nine_k 9mo ago
Is there something similar, but geared towards a Linux desktop / laptop? I suppose this would be relatively easy to adapt.
- ali_chherawalla 9mo agoLM Studio solves for it pretty well I think. It doesn't do image gen etc though
- jeroenhd 9mo agoIf you have enough (V)RAM you can set up Ollama + any of the generation tools here (https://docs.openwebui.com/category/create--edit-images https://docs.openwebui.com/category/create--edit-images) and hook them into OpenWebUI to get something pretty close to what you'd get on a cloud AI chatbox. Decently performing models for day to day use cases use at least 6GB VRAM each, though, and even then they're not coming very close to what the cheapest AI websites offer.