4 ms·
Because they proposed "fixing" the benchmarks by doing this, at which point I am asking what you hope to see in the benchmark if everything is the same. They c
by diffeomorphism 7y ago
Because they proposed "fixing" the benchmarks by doing this, at which point I am asking what you hope to see in the benchmark if everything is the same.
They consider difference due to compiler versions to be "wrong", differences in flags to be "wrong" etc. . So "the difference comes from the parts that hadn't changed", yeah which ones would you permit to change to consider the benchmark not "wrong"?
- trasz 7y agoThe difference due to compiler versions isn’t wrong. What’s wrong is attributing it to the operating system. Especially given how easy it would be to just keep the same compiler version. The problem with Phoronix v the build flags is not that they are different between systems/distros; quite the opposite: Phoronix builds the software in an unsupported way, ignoring system/distribution defaults. Which means, they measure software that’s miscompiled/misconfigured.