4 ms·
OpenAI has a 40k token per minute rate limit on their GPT4 API too so I doubt it's artificial scarcity.
by akiselev 3y ago
OpenAI has a 40k token per minute rate limit on their GPT4 API too so I doubt it's artificial scarcity.
- dontupvoteme 3y agoPerhaps. I found it was far too easy to hit the API limit with their old codex models, though that may have been limited to a small GPU cluster given it was pretty obscure compared to chatgpt and even davinci.