3 ms·
I’ve never seen linear scaling from a dual GPU setup. IMO you’re doing well to get 70% from the second CPU under full load.
by Retric 4y ago
I’ve never seen linear scaling from a dual GPU setup. IMO you’re doing well to get 70% from the second CPU under full load.
- toast0 4y agoDepends, sometimes you get better scaling from having 2x the cpu and 2x the memory (maybe 2x the disk) all in one box than if you have to split it up and have more cross-server connectivity. You wouldn't buy a dual socket box for 3x the money if you didn't think you'd get 3x the performance out of it, unless you really wanted to keep your server count down.
- aetherspawn 4y agoFor us, we only allocate ie 8 runners to a VM with 8 cores, which we pin to 8 cores on the actual server, so our focus is getting as many cores as possible to get as many runners as possible. We kind of expected that scaling HW with more CPUs instead of more entire rack systems would be more energy efficient, but I don’t think it makes too much of a difference compared to other factors like CPU/vendor architecture. FWIW our energy bill is $1000+ per month just from servers, and then several $k for various licensing on each host per year, so there was some sweet spot we were optimising for (low power, but less licensing cost via less racks). Our cost in the cloud would be $5k per month or more, so either way we still saved money this year.
- Retric 4y agoMy point was simply expecting linear scaling is a recipe for failure. Spending 3x as much for a 50% improved performance can be the best option.