3 ms·
I really like LM Studio and had it open when I came across this post. LM Studio is an interesting mixture of: - A local model runtime - A model catalog - A U
by omneity 3y ago
I really like LM Studio and had it open when I came across this post. LM Studio is an interesting mixture of:
- A local model runtime
- A model catalog
- A UI to chat with the models easily
- An openAI compatible API
And it has several plugins such as for RAG (using ChromaDB) and others.
Personally I think the positioning is very interesting. They're well positioned to take advantage of new capabilities in the OS ecosystem.
It's still unfortunate that it is not itself open-source.
- addandsubtract 3y agoDoes it also let you connect to the ChatGPT API and use it?
- omneity 3y agoI haven’t found that option. I know it exists in Gpt4all though. Personally I use a locally served frontend to use ChatGPT via API.
- SOLAR_FIELDS 3y agoHow does it compare with something like FastChat? https://github.com/lm-sys/FastChat https://github.com/lm-sys/FastChat Feature set seems like a decent amount of overlap. One limitation of FastChat, as far as I can tell, is that one is limited to the models that FastChat supports (though I think it would be minor to modify it to support arbitrary models?)
- gmgmgmgmgm 3y agoOne, LMStudio, is an app. you download it, run it, you're immediately working The other is some python thing that requires python knowledge of creating virtual environments, installing dependencies, etc...