4 ms·
Google does a lot of micro-optimizations. There are services where latency is important, they launch multiple requests to different replicas but to optimize th
by pas 8y ago
Google does a lot of micro-optimizations.
There are services where latency is important, they launch multiple requests to different replicas but to optimize this when one of the replicas is serving the response it sends a request cancel to the other one.
Horizontal scaling and vertical scaling is both very important.
Both G and FB pours many engineering hours into maximizing per server "ROI". Just think about how much they work on scheduling work/tasks so they can do more with the same number of servers.