3 ms·
Does this support using only private LLM instances? Does it integrate with Amazon Bedrock?
by codexb 3mo ago
Does this support using only private LLM instances? Does it integrate with Amazon Bedrock?
- segmenta 3mo agoYou can use both private LLM instances or hosted ones. On private we support Ollama, LM Studio and any OpenAI compatible API. In hosted, we support: OpenAI, Anthropic, Gemini, OpenRouter, Vercel AI Gateway. No native Amazon Bedrock support, but you could use OpenRouter or LiteLLM with the Bedrock key and point Rowboat to that today.