3 ms·
I think fail-over for a production critical service is an equally important responsibility of the router.
by robertclaus 2mo ago
I think fail-over for a production critical service is an equally important responsibility of the router.
- ramraj07 2mo agoYou cant fail over to a different model though. Even failing over to a different provider isn't always as simple as set it and forget it. For example bedrock doesn't support the tool search tool feature from anthropic.
- jml78 2mo agoThey beta support for it now I believe
- brunaxLorax 2mo agoI didn't know that! I thought that all models had the same features no matter the provider
- brunaxLorax 2mo agoYes, providers have downtime and retry/fallback solves this problem.