4 ms·
The other thing OpenRouter gets you is: Access to loads of models via a common API/sign-up/prepayment mechanism. I want to know which vendor/model does best at
by michaelt 2mo ago
The other thing OpenRouter gets you is: Access to loads of models via a common API/sign-up/prepayment mechanism.
I want to know which vendor/model does best at my extracting-facts-from-text task? Which does best at my OCR-a-text-document task? Which can deal with a safe-for-work beach photo without a censorship system false alarm?
OpenRouter lets me run my tests against openai and anthropic and google and x and bytedance and qwen and llama, with a single sign-up and a single payment.
- catlifeonmars 2mo agoYou can do that with AWS too.
- walthamstow 1mo agoAWS Bedrock's model offering is tiny compared to Open Router. I have to agree with GP, there's no better way to run an eval suite against many models
- pbreit 1mo agoThe other thing is, aren't the models mostly indistinguishable at this point?