3 ms·
I'm thinking about this problem in the context of a data ingestion API where the requests are processed asynchronously. The latency from the client to the back
by trienism 10y ago
I'm thinking about this problem in the context of a data ingestion API where the requests are processed asynchronously.
The latency from the client to the backend is not really an issue so long as the request is processed at some point. In this situation, I'm looking at the throughput and cpu usage to see how far an instance can scale.
Am I missing something, or does latency not really play a large role in this particular scenario?
- vikiomega9 10y agoWell, for your setup latency has no effect. The constraint here is how quickly you can process incoming requests. Throughput on the system would simply depend on how much of resource you have that process those requests.
- deleted 10y ago[deleted]