3 ms·
> If you do a test that shows that X is faster than Y, you're allowed to say "X proved faster than Y". No, you have the hypothesis X is faster than Y, and some
by kortex 4y ago
> If you do a test that shows that X is faster than Y, you're allowed to say "X proved faster than Y".
No, you have the hypothesis X is faster than Y, and some evidence to back it up. It's no different than a scientist treating cancer cells with unobtainium, and claiming it "proves unobtanium cures cancer".
You need a lot more rigor to prove benchmarks. Notably absent is some independent verification and peer review. It's possible to write benchmarks in ways that bias the outcome.
If you have multiple different benchmarks written by independent authors and counter-reviewed, all showing 10x speedup, sure, call it "proven". A few benchmarks on 3 arches, no, use the word "shown" or similar.