3 ms·
Yes - you can use local LLMs through LiteLLM and Ollama. Would you like us to support anything else?
by segmenta 11mo ago
Yes - you can use local LLMs through LiteLLM and Ollama. Would you like us to support anything else?
- thedangler 11mo agoLM Studio?
- ramnique 11mo agoYes, because LM Studio is openai-compatible. When you run rowboatx the first time, it creates a ~/.rowboat/config/models.json. You can then configure LM Studio there. Here is an example: https://gist.github.com/ramnique/9e4b783f41cecf0fcc8d92b277d4d308 https://gist.github.com/ramnique/9e4b783f41cecf0fcc8d92b277d...