3 ms·

Can this use local LLMs?

• segmenta 11mo ago
  Yes - you can use local LLMs through LiteLLM and Ollama. Would you like us to support anything else?
  • thedangler 11mo ago
    LM Studio?
    • ramnique 11mo ago
      Yes, because LM Studio is openai-compatible. When you run rowboatx the first time, it creates a ~/.rowboat/config/models.json. You can then configure LM Studio there. Here is an example: https://gist.github.com/ramnique/9e4b783f41cecf0fcc8d92b277d4d308 https://gist.github.com/ramnique/9e4b783f41cecf0fcc8d92b277d...