2 ms·
Thanks for that. Are there any proxies that can communicate with bedrock and serve it via a OpenAI style api?
by teruakohatu 2y ago
Thanks for that. Are there any proxies that can communicate with bedrock and serve it via a OpenAI style api?
- moduspol 2y agoYou'd have to deploy it yourself, but there's this: https://github.com/aws-samples/bedrock-access-gateway https://github.com/aws-samples/bedrock-access-gateway
- teruakohatu 2y agoThanks. That is quite a heavy stack!
- popinman322 2y agoTry LiteLLM; their core LLM proxy is open source. As an added bonus it also supports other major providers.