5 ms·
As a developer I am keen to see some compilation benchmarks. Unfortunately those kinds of benchmarks are almost never included in such reviews. Instead there ar
by ibobev 7y ago
As a developer I am keen to see some compilation benchmarks. Unfortunately those kinds of benchmarks are almost never included in such reviews. Instead there are many gaming benchmarks which purpose is not exactly clear for me, after obviously gaming is not the primary target market for R9 3950X.
- mmastrac 7y agoI believe that some of the YouTube channels have started including compilation benchmarks. GamersNexus [1] and Linus Tech Tips [2] both do! [1] https://www.gamersnexus.net/guides/3460-new-cpu-bench-methodology-workstation-program-compile-tests-premiere https://www.gamersnexus.net/guides/3460-new-cpu-bench-method... [2] https://youtu.be/stM2CPF9YAY?t=4m49s https://youtu.be/stM2CPF9YAY?t=4m49s
- simplyinfinity 7y agoIn addition, Level1Techs is more developer/sysadmin oriented than consumer oriented : https://www.youtube.com/channel/UC4w1YQAJMWOz4qtxinq55LQ https://www.youtube.com/channel/UC4w1YQAJMWOz4qtxinq55LQ
- polivka2 7y agoAnd in addition to that, we have Open benchmarking and Phoronix for that. :)
- velox_io 7y agoLikewise (I 2nd L1Techs btw). Having 16 cores/ 32 threads will greatly aid testing server applications. Making multi-threading & locking issues much more apparent (Amdahl's law) than they would on a slightly older CPU with only 4-6 cores (a i7 6700k in my case).
- sbov 7y agoNote that the GamerNexus review of the 3950x didn't include their compile benchmark test, at least on Youtube.
- IanCutress 7y agoNormally we at AnandTech run a Chrome compile benchmark, but for whatever reason it wasn't running properly on Win 10 1909. When I get a chance to debug (55k miles of travel over the next four weeks), I'm going to see if I can fix it and expand that bit of our testing.
- gameswithgo 7y agoGCC at least goes very fast on the new Ryzens, due to the huge l3 cache. That may translate to many compilers. Rust (which uses llvm on the backend) also compiles very quick.
- velox_io 7y agoFor the 4000 series, they're planning on sharing the L3 caches between CCD's/ chiplets rather than per CCX. It will be interesting to see if the more cache availible per core, and more cores being able to access the same cache will improve the performance. The speed AMD has raised caches & core-count lately is insane. When the max for mainstream CPUs was 8MB (and 4 cores) until only a few years ago. (Things seem to have stopped when quad-core launched, the Intel Q6600 was an amazing CPU at the time.) I've been a computer enthusiast for over 20 years and didn't expect to see advancements to return like the good ol' days (Moore's law) to ever return. (I don't think Intel did either, halving their prices pre-launch is unprecidented!)
- gameswithgo 7y agoYes I look forward to the better cache system in the next generation! Do remember that part of how AMD can get so much L3 on there, is due to the chiplet design, which also adds a LOT of latency to ram accesses. Almost all of the time, it seems to be a net win though, and with the next generation it will only get better.
- mjevans 7y agoIt would be interesting if we moved back to the final layer of cache being off-core, likely within the IO die or attached as additional chips within the package. That should decrease the core size, improve yields, and allow for differentiation in L3 size as well.
- gameswithgo 7y agobut it would add latency :( but maybe an L4 cache, off core, as additional chips!
- e12e 7y agoAgreed. At least it's part of the phoronix benchmark, and openbench has some results: https://openbenchmarking.org/showdown/pts/build-linux-kernel https://openbenchmarking.org/showdown/pts/build-linux-kernel I'd love to hear of a more richly supplied crowd sourced database.
- deleted 7y ago[deleted]
- Matthias247 7y agoAs already said by others, Phoronix has some compilation benchmarks. I have recently bought a 3900X. Some things about compilation I would note is that it heavily depends on your programming language and tooling. And that you would note is that you get most benefits on clean builds of big projects, which scale very well per core. On incremental builds or smaller projects it is however not uncommon to see < 25% of the CPU being used. That is especially with Rust, where a single compilation unit (crate) is compiled in a single-threaded fashion. Might be better with C or C++. But then again linking might also be blockers. It's all nice and fast, but on day to day use you likely won't see a 100% speed increase compared to a 3600.
- zlynx 7y agoBeside clean builds is Git branch checkouts. I hit this at least twice a week. Finish a feature branch and push it. Check out master. Pull master. Make new feature branch. Get an urgent bug fix request, switch to release branch, make a bugfix branch. Now go back to the new feature. During this I may end up doing large rebuilds because Git changes modification times even if you end up back with the same header file you started with. On a Thinkpad T540 the rebuild can take 30 minutes. It's less than 5 on a 3900X.
- namibj 7y agoUse a build system that works with input-hashes. djb's redo is an example.
- nwallin 7y agoccache solves this fairly well if you're on *nix.
- boring_twenties 7y agoDo you know about `git worktree`? You may not want a separate one for each branch you work on, but at least one for master and one for release would help you I think.
- 7y ago
- spamizbad 7y agoI'd love to see more container-oriented benchmarks, particularly with docker-compose and/or minikube.
- lliamander 7y agoAs a developer, other benchmarks I would like to see: * compile benchmarks for different mainstream languages (Java, C#, etc.) * IDE related benchmarks (i.e. how long does it take to index a large solution/workspace) * source control conversion tests (svn to git). Obviously not something that happens everyday, but I've done it at two different jobs, and generally when it happens you are often converting many repos as an organization shifts its policy. * maybe some VM/docker related tests I'm probably asking for too much, but working on a micro-service system even with enough RAM my system becomes less responsive when I'm testing the interactions between services on my local machine. I'm also limited on the number of Java projects I can add into a single workspace in Intellij. I've been forced to open each project as a separate workspace and in a separate window. Granted, I'm working off of a dual-core i7 laptop (with 32GB of RAM) but I want to know what kind of upgrade it would take for those problems to go away. > Instead there are many gaming benchmarks which purpose is not exactly clear for me, after obviously gaming is not the primary target market for R9 3950X. Well, it must be said that the 3950X has the fastest single-core performance of AMD's lineup, so while it is overkill from a core-count perspective, it's still technically their best gaming CPU.
- IanCutress 7y agoGot any standardized methods that could be automated/scripted under a clean Windows environment and doesn't require internet access / licensing? Give me a shout - ian@anandtech.com
- fierarul 7y agoMaybe anandtech.com could create / pay for such tests?
- hajile 7y agoLinux Kernel would probably be good. WSL could probably do it without much trouble though I don't know how WSL affects performance compared to native Linux. Compiling Visual Studio Code Typescript could be an interesting target too. There should be a large open-source C# and/or Java project out there that can be compiled as well.
- IanCutress 7y agoNormally I run a Chrome compile benchmark, but for whatever reason it wasn't running properly on Win 10 1909. When I get a chance to debug (55k miles of travel over the next four weeks), I'm going to see if I can fix it and expand that bit of our testing.