3 ms·
I pay per token using an API (Vertex) 1. Higher limits and quota, goes up with more spend 2. I don't think it gets quant nerf's during busy times, since you a
by verdverm 8mo ago
I pay per token using an API (Vertex)
1. Higher limits and quota, goes up with more spend
2. I don't think it gets quant nerf's during busy times, since you are paying directly
3. With Gemini flash + CC prompts, it's nearly as good, so less spend and latency. I don't know how people deal with the delays between turns. I get to iterate much faster for most tasks
- cortesoft 8mo agoI don't seem to have any delays between turns with my Claude subscription, so not sure what you mean there. Your second point seems like a guess. For your first point, I bumped to the $100 plan because i was hitting limits with the $20 one, but haven't hit the limit with the new one yet...
- verdverm 8mo agoI mean the 10-30s to wait for a frontier model to respond when the lite/flash models are just fine for almost all tasks