3 ms·
No because switching to the API with the same prompt immediately fixes it. There's little incentive to throttle the API. It's $/token.
by acuozzo 9mo ago
No because switching to the API with the same prompt immediately fixes it.
There's little incentive to throttle the API. It's $/token.