30 ms·
It'd be kinda nice if they exposed whatever queuing is going on behind the scenes, so you could at least communicate that to your users.
by phantasmish 10mo ago
It'd be kinda nice if they exposed whatever queuing is going on behind the scenes, so you could at least communicate that to your users.
- aamoscodes 10mo agoIIRC this is almost exactly the use case for OpenRouter, down to provider fallback https://openrouter.ai/docs/guides/best-practices/uptime-optimization https://openrouter.ai/docs/guides/best-practices/uptime-opti...