3 ms·
I haven't tried self-hosting due to the hesitation around the general drab I've experienced in the past trying trying to host other ML models. Find a repo. fol
by thatcherthorn 3y ago
I haven't tried self-hosting due to the hesitation around the general drab I've experienced in the past trying trying to host other ML models.
Find a repo. follow the install instructions. What is this weird error? A library issue..? Maybe it's my OS..?
It always seems to be tedious compared to open projects in other domains. Maybe that can't be solved.
- smcleod 3y agoI replied to a comment in another post yesterday on this - https://news.ycombinator.com/item?id=37120346 https://news.ycombinator.com/item?id=37120346 Honestly the easiest way that “just works” is to use LM Studio which you can run locally https://lmstudio.ai/ https://lmstudio.ai/ Obviously you’ll have faster results if you have a fancy gaming GPU or something like the M2 Max/Ultra but you don’t need those to have a play and see if it interests you.
- bheadmaster 3y agoIn my experience, people specialzed in machine learning are usually researchers and mathematicians, not engineers. Writing a package that will work on any random person's hardware and system is a non-trivial engineering task.
- vorpalhex 3y agoLlama models have been pretty easy to host. StableDiffusion was a real nightmare when it came out (and still is at times). Using docker has an initial threshold you have to get over but once you do, everything becomes very easy in it. How you end up using docker matters very little once you get the concepts.
- vorticalbox 3y agoI just use GTP4all [0] both the GUI and the python bindings[1] [0] https://gpt4all.io/index.html https://gpt4all.io/index.html [1] https://docs.gpt4all.io/ https://docs.gpt4all.io/