2 ms·
What makes PassMark a representative CPU benchmark? These one-company CPU benchmarks tend to be quite problematic (cf. GeekBench). SPEC just came out with CPU2
by fulafel 9y ago
What makes PassMark a representative CPU benchmark? These one-company CPU benchmarks tend to be quite problematic (cf. GeekBench).
SPEC just came out with CPU2017. In SPEC there's at least a bunch of peer review, transparency and attention from academics.
Here are Anandtech's AMD vs Intel CPU2006 numbers:
http://www.anandtech.com/show/11544/intel-skylake-ep-vs-amd-epyc-7000-cpu-battle-of-the-decade/14 http://www.anandtech.com/show/11544/intel-skylake-ep-vs-amd-... http://www.anandtech.com/show/11544/intel-skylake-ep-vs-amd-epyc-7000-cpu-battle-of-the-decade/15 http://www.anandtech.com/show/11544/intel-skylake-ep-vs-amd-...
- gcp 9y agoSPEC is very useful, but it's harder to get results, much less people who have access to the suite, and there is a strong influence of the compiler (SPEC2017 will tone this down early on, but there's almost no results out). I believe AMD released AOCC partially to get a competitive position for SPEC. (Remember the controversial slides with the non-reportable gcc 6.3 results) Don't get me wrong, I would love CPU2017 results for TR vs 7820X etc.
- onli 9y ago> What makes PassMark a representative CPU benchmark? Sadly nothing. PassMark is infamous for being not representative, and you can easily check that by looking at the position of the FX processors, which are rated way too high. I run a pc hardware builder with a recommender function at its core, which means that the real core is the meta benchmark powering the recommender. It works by taking professional reviews of real life workloads, and I think it is a lot more realistic, though absolute ordering is of course not that easy. I recently made the benchmark results visible, there is one for games: https://www.pc-kombo.com/benchmark/games/cpu https://www.pc-kombo.com/benchmark/games/cpu and one for applications: https://www.pc-kombo.com/benchmark/apps/cpu https://www.pc-kombo.com/benchmark/apps/cpu . Threadripper is in there and the big model leads the app benchmark, but I still need to add more benchmarks with the threadripper processors to make the result more certain. At the beginning I even started with the passmark results, but had to move to better data when user complained the results were not good. They were right.
- Brockenstein 9y agoIt's not authoritative. But in order to get a truly complete picture of CPU performance you've got to do all sorts of different workloads and between the benchmarks and real world performance you get kind of a muddle of: "In highly threaded apps, AMD's high core CPU's stomp everything, especially for the price. Single core performance still belongs to Intel." And then from there individual users need to figure out which CPU's are best for their use case. And a lot of users kind of want it summed up instead of sorting that out. That aside AMD has a really good product this generation, compared to Bulldozer and it does hark back the previous decade where AMD's CPUs were truly viable competition to Intel's. I'm not sure how Passmark derives their scores exactly. But based on what I'm seeing for all sorts of reviews is that Threadripper is a formidable chip and between an extremely high number of cores and low price I can't help but believe that spot is earned. Even if it is ultimately meaningless. It won't last forever either, but it will force Intel to respond. And that's what we've all wanted for the last 10 years.
- mtgx 9y agoIt seems to have been representative enough during the time when Intel's CPUs were wiping the floor with the AMD CPUs on the very same benchmarks.