3 ms·
There are more subtle variations on this that still affect the harder sciences. A topic closer to home for most of us might be benchmarking. It is terribly di
by brandmeyer 7y ago
There are more subtle variations on this that still affect the harder sciences.
A topic closer to home for most of us might be benchmarking. It is terribly difficult to construct an honest A/B comparison between two different algorithms, especially when the person doing the testing designed B themselves.
- kragen 7y agoIt's usually easy to get benchmark results that are reproducible within 10% or so, though often people don't bother. With careful work you may be able to get benchmarks reproducible to 9 significant figures. See SUPERCOP for an example. Now, your reproducible results may or may not be fair, but that's an issue further down the line.