3 ms·
Did the 100% system utilisation also lead to better performance? More cpu utilisation doesn’t always mean faster or higher throughput.
by spockz 6y ago
Did the 100% system utilisation also lead to better performance? More cpu utilisation doesn’t always mean faster or higher throughput.
- pdimitar 6y agoThis can't be generalised but in many cases it did help me for CPU-bound tasks. Obviously there are cases where parallelisation is very superfluous. F.ex. if you have 1000 records of something, splitting the work of processing those (and we're talking really light processing like JSON encoding) among 4-8 threads is actually detrimental to performance.
- qchris 6y agoThat's certainly true, but it does look like in this case. I did the preliminary benchmarking on an 8-thread CPU (the actual HPC cluster has higher counts), and the total execution time on the processing was just under 8x, which I imagine came from the OS-level thread management overhead. I still need to check that pattern holds once thread counts increases, but I'm fairly optimistic it'll work out as long as I don't run into thermal throttling or I/O limits.