4 ms·
Dynamic spurious profit probing. See how many users N times their usage without giving up forever. They have to do something because you can't really fist adver
by beefnugs 1y ago
Dynamic spurious profit probing. See how many users N times their usage without giving up forever. They have to do something because you can't really fist advertisements into an api
- dmix 1y agoOP is paying $200/m and anthropic is very much in the hyper funded growth stage. I very much doubt they are going accountant mode on it yet Likely the common young startup issues: a mix of scaling issues and poorly implemented changes. Improve one thing, make other stuff worse etc
- jazzyjackson 1y agoProbably not accountant mode but haven't they always had daily quotas that get used up? Like they don't want everyone hitting the service nonstop because they don't have enough GPUs to run inference at peak times of day? So it could be a matter of serving more highly quantized model because giving bad results has higher user retention than "try again later"