2 ms·
The main thing about Openrouter is also that they take 100% of the risk in case of overcharges from the models, you have an actual hard cap. The minus is that
by rvnx 6mo ago
The main thing about Openrouter is also that they take 100% of the risk in case of overcharges from the models, you have an actual hard cap.
The minus is that context caching is only moderately working at best, rendering all savings nearly useless.
- SR2Z 6mo agoIs there any risk? Don't the model providers also bill by the token?
- fuzzy2 6mo agoThe accounting could be asynchronous, so you could overshoot your budget by a few requests before you're blocked.
- largbae 6mo agoI haven't noticed any problems with large context requests through OR to e.g. Opus (other than the rate at which my budget gets spent!). Is this a performance thing?