3 ms·
If you look at their API limits, no serious company can use this to scale up beyond say 10k users. 3500 Reqs per min for gpt3.5 turbo. They have a long way to
by m3kw9 3y ago
If you look at their API limits, no serious company can use this to scale up beyond say 10k users. 3500 Reqs per min for gpt3.5 turbo. They have a long way to go to make it usable for the rest of the 95%
- thorax 3y agoI've had to move to using Azure OpenAI service during business hours for the API-- much more stable unless the prompts stray into something a little odd and their API censorship blocks the calls.
- nonfamous 3y agoYou can opt out of the safety filtering, btw.
- legendofbrando 3y agoI’ve been working directly with OpenAI’s access, are there any other advantages to doing this through Azure?