11 ms·
Anyone who does SoC evaluation or large purchases know that any synthetic benchmark are BS. Every vendor tailor-adapts their drivers/workloads/etc to make them
by vvanders 9y ago
Anyone who does SoC evaluation or large purchases know that any synthetic benchmark are BS. Every vendor tailor-adapts their drivers/workloads/etc to make them look "the best"[1].
See: GPU drivers checking running process, bumping voltages and all sorts of other shenanigans.
[1] https://www.anandtech.com/show/7384/state-of-cheating-in-android-benchmarks https://www.anandtech.com/show/7384/state-of-cheating-in-and...
- semi-extrinsic 9y agoWell, yes and no. Linpack is pretty useless, but STREAMS Triad is actually a very good proxy for problems that are memory bandwidth bound, and the only way to "game" it is to actually provide a better chip.
- vvanders 9y agoOh you can totally game those things by ignoring your thermal limits and/or overclock briefly since you know the exact duration of the test. It's a really common approach in the GPU chip space. The right way to do things is have a private test that matches a slice of your real workload. That way the vendor can't tailor their chips/drivers to it.