2 ms·
I think you misread my post. My point is that everyone optimizes their implementation so that their benchmarks run fast. Furthermore, people pick benchmarks tha
by kevingadd 14y ago
I think you misread my post. My point is that everyone optimizes their implementation so that their benchmarks run fast. Furthermore, people pick benchmarks that run fast on their implementation. Neither of these are a 'little dodgy': They are how benchmarks get used.
You might note that they make for bad science, but benchmarks tend not to get used in anything resembling a scientific comparison. Benchmarks get used for comparative testing (did we make thing X faster than it was before?) and to try and prove that your product is better than the competition (in which case much larger lies are going to get trotted out either way).