4 ms·
An operator at load capacity can either refuse requests, or move the knobs (quantization, thinking time) so requests process faster. Both of those things make c
by exitb 8mo ago
An operator at load capacity can either refuse requests, or move the knobs (quantization, thinking time) so requests process faster. Both of those things make customers unhappy, but only one is obvious.
- codeflo 8mo agoThis is intentional? I think delivering lower quality than what was advertised and benchmarked is borderline fraud, but YMMV.
- chrisjj 8mo agoThere is no level of quality advertised, as far as I can see.
- pseidemann 8mo agoWhat is "level of quality"? Doesn't this apply to any product?
- chrisjj 8mo agoIn this case, it is benchmark performance. See the root post.
- denysvitali 8mo agoIf there's no way to check, then how can you claim it's fraud? :)
- mcny 8mo agoPersonally, I'd rather get queued up on a long wait time I mean not ridiculously long but I am ok waiting five minutes to get correct it at least more correct responses. Sure, I'll take a cup of coffee while I wait (:
- lurking_swe 8mo agoi’d wait any amount of time lol. at least i would KNOW it’s overloaded and i should use a different model, try again later, or just skip AI assistance for the task altogether.
- bpavuk 8mo ago> I think delivering lower quality than what was advertised and benchmarked is borderline fraud welcome to the Silicon Valley, I guess. everything from Google Search to Uber is fraud. Uber is a classic example of this playbook, even.
- copilot_king 8mo ago[flagged]
- rootnod3 8mo agoThat number is a sliding window, isn't it?
- TedDallas 8mo agoPer Anthropic’s RCA linked in Ops post for September 2025 issues: “… To state it plainly: We never reduce model quality due to demand, time of day, or server load. …” So according to Anthropic they are not tweaking quality setting due to demand.
- rootnod3 8mo agoAnd according to Google, they always delete data if requested. And according to Meta, they always give you ALL the data they have on you when requested.
- entropicdrifter 8mo ago>And according to Google, they always delete data if requested. However, the request form is on display in the bottom of a locked filing cabinet stuck in a disused lavatory with a sign on the door saying ‘Beware of the Leopard'.
- groundzeros2015 8mo agoWhat would you like?
- AlexandrB 8mo agoAn SLA-style contractually binding agreement.
- edmundsauto 8mo agoI bet this is available in large enterprise agreements. How much are you willing to pay for it?
- Onavo 8mo agoPriced in.
- cmrdporcupine 8mo ago
- direwolf20 8mo agoThey don't advertise a certain quality. You take what they have or leave it.
- sh3rl0ck 8mo agoI'd wager that lower tok/s vs lower quality of output would be two very different knobs to turn.