4 ms·
Maybe it's easier to just set up a proxy mirroring Anthropic's API, but pointing to whatever model you want? Genuine doubt.
by haolez 2y ago
Maybe it's easier to just set up a proxy mirroring Anthropic's API, but pointing to whatever model you want? Genuine doubt.
- npace12 2y agoIt's not much different than your proxy idea. It's implemented as a transformation between the internal message structure (close to Anthropic API's) to OpenAI message spec and vice-versa. Then, it's calling all the other models using the openai-node client, as pretty much everyone supports that now (openrouter, ollama, etc)
- haolez 2y agoCool! The only downside would be keeping your code in sync with upstream, then.