2 ms·
Does this support using only private LLM instances? Does it integrate with Amazon Bedrock?
by codexb 4mo ago
Does this support using only private LLM instances? Does it integrate with Amazon Bedrock?
- segmenta 4mo agoYou can use both private LLM instances or hosted ones. On private we support Ollama, LM Studio and any OpenAI compatible API. In hosted, we support: OpenAI, Anthropic, Gemini, OpenRouter, Vercel AI Gateway. No native Amazon Bedrock support, but you could use OpenRouter or LiteLLM with the Bedrock key and point Rowboat to that today.