4 ms·
Hm, I'd guess, it's latency to backend servers. Cores are plenty fast for just about every language. If you have a good network between systems, each request o
by tetha 9y ago
Hm, I'd guess, it's latency to backend servers. Cores are plenty fast for just about every language.
If you have a good network between systems, each request of any form to a backend service will introduce at least 0.5 ms of response time due to datacenter RTA, so once you hit 250 queries, that's that. And 250 queries are just one n+1 problem somewhere.
- syrrim 9y agoThe OP says the call is CPU bounded, which suggests that even if time is spent on the network, it is a minority of the total time.