3 ms·
LM Studio, sort of. Unfortunately my Macbook is incapable of running all but the smallest models. It would be great if LM Studio can connect to a remote model r
by FooBarWidget 3y ago
LM Studio, sort of. Unfortunately my Macbook is incapable of running all but the smallest models. It would be great if LM Studio can connect to a remote model running on a GPU server that I can rent.
- jerpint 3y agoYou could set up something similar using gradio quite easily: https://www.jerpint.io/blog/model-inference/ https://www.jerpint.io/blog/model-inference/