3 ms·
Sonnet is also throwing overloaded error. My systems are hitting exponential delay retries, so this might not get better because retries overload things again.
by gopalv 5mo ago
Sonnet is also throwing overloaded error.
My systems are hitting exponential delay retries, so this might not get better because retries overload things again.
> {'type': 'error', 'error': {'details': None, 'type': 'overloaded_error', 'message': 'Overloaded'}, 'request_id': 'req_ ...
I can see a weird spike in my cache hit-rate a few minutes before, so this might actually be some extra caching they have thrown in.