3 ms·
>> Fixing throughput is usually more straightforward and easier than fixing latency. (Pareto principle) > No, because improving throughput requires a generatio
by Scramblejams 10y ago
>> Fixing throughput is usually more straightforward and easier than fixing latency. (Pareto principle)
> No, because improving throughput requires a generational GC
Or more boxes. From the perspective of an end user or IT admin, if you have a throughput problem, you can (assuming the task lends itself) solve it with horizontal scaling. If you have a latency problem, you can only scale vertically. If scaling vertically doesn't do the trick, you're out of luck.
This is why when I have to make a choice between latency and throughput, if there's no obviously correct answer I default to latency. Intel will eventually solve my throughput problems, but they won't be able to do much about my latency problems.