3 ms·
Good luck using 2.5 for anything non-trivial. I have about 500,000 news articles I am parsing. OpenAI models work well but found Gemini had fewer mistakes. Pr
by zzleeper 1y ago
Good luck using 2.5 for anything non-trivial.
I have about 500,000 news articles I am parsing. OpenAI models work well but found Gemini had fewer mistakes.
Problem is; they give me a terrible 10k RPD limit. To increase to the next tier, they then require a minimum amount of spending but I can't reach that amount even when maxing the RPD limit for multiple days in a row.
I emailed them twice and completed their forms but everyone knows how this works. So now I'm back at OpenAI, with a model with a bit more mistakes but that won't 403 me after half an hour of using it due to their limits.
- eldenring 1y agoI'm guessing now that it is GA this won't be a problem.
- zzleeper 1y agoI wish! The tier-based limits are still the same! At least it's more expensive now so I guess I will be able to hop to the next tier sooner? ¯\_(ツ)_/¯
- be7a 1y agoThe rate limits apply only to the Gemini API. There is also Vertex from GCP, which offers the same models (and even more, such as Claude) at the same pricing, but with much higher rate limits (basically none, as long as they don't need to cut anyone off with provisioned throughput iiuc) and with a process to get guaranteed throughput.
- zzleeper 1y agoHad no idea... always thought Vertex was just a way to do enterprise offering!