6 ms·
I don't know that it's all so bad. The final takeaway is that a 660mm2 Intel die at 270W got about 70-80% of the performance that AMD's 1000mm2 MCM gets at 250
by ajross 6y ago
I don't know that it's all so bad. The final takeaway is that a 660mm2 Intel die at 270W got about 70-80% of the performance that AMD's 1000mm2 MCM gets at 250W. So performance per transistor is similar, but per watt Intel lags. But then the idle draw was significantly better (AMD's idle power remains a problem across the Zen designs), so for many use cases it's probably a draw.
That sounds "competetive enough" to me in the datacenter world, given the existing market lead Intel has.
- ComputerGuru 6y agoI would argue that for high-end servers, idle draw is a bit of a non-issue as presumably either you have only one of these machines and it’s sitting idle (so no matter how inefficient it doesn’t matter) or you have hundreds/thousands of them and they’ll be as far from idle as it’s possible to be. AMD’s idle power consumption is a bigger issue for desktop, laptop, and HEDT.
- ajross 6y agoElectricity costs for large datacenters are higher than the equipment costs. They absolutely care about idle draw.
- spideymans 6y agoShouldn't datacenters attempt to minimize idle time though? A server sitting at idle is a depreciating asset that could likely be put to more productive use if tasks were rescheduled to take advantage of idle time (this would also reduce the total number of servers needed).
- gumby 6y agoThat is definitely the objective but the reality is that load is not* uniform over the day. So you are paying to keep some number of servers hot (I don't know about spinup/spindown practices in modern datacenters). I doubt this applies to HPC (the target market for this part) as they either schedule jobs closely or could, I imagine, shut them down. But I'm not in that space either so this is merely conjecture. * I am sure there are corner cases where the load is uniform, but they are by definition few.
- deelowe 6y agoUtilization is a very difficult problem to solve. The difference between peak and off peak utilization can be as much as 70% or more depending on the application.
- ComputerGuru 6y agoIf you have enough servers for idle draw to be more than a rounding error in your opex breakdown, then you have a strategy to keep idle time to zero. It doesn’t make any financial sense (no matter how low idle draw is) to have a server sit idle (or even powered off, but that’s a capex problem).
- my123 6y agoFor a cloud infrastructure, you have a significant part at idle, for when customers want to instantly spawn a VM.
- jrockway 6y agoYeah, I think it's hard to keep your computers at 100% utilization for the entire day. You host services close to your users, and your users go to bed at some point, many of them at around the same time every day. Then your computers have very little work to do. Some bigger companies have a lot of batch jobs that can run overnight and steal idle cycles, but you have to be gigantic before that's realistic. (My experience with writing gigantic batch jobs is that I just requisitioned the compute at "production quality" so I could work on them during the day, rather than waiting for them to run overnight. Not sure what other people did, and therefore not really sure how much runs overnight at big companies.) Cloud providers have spot instances that could take up some of this slack, but I bet there is plenty of idle capacity precisely because the cost can't go to $0 because of electricity use. Or I could be completely wrong about workloads, maybe everyone has their web servers and CI systems running at 100% CPU all night. I've never seen it, though.
- thekrendal 6y agoOr for redundancy sake, if you're using any kind of sane setup. (Yes, YMMV bigly with this particular idea.)
- zsmi 6y agoThe target market for this part is not that kind of datacenter. Based on the article they're targeting high performance compute, i.e. "application codes used in earth system modeling, financial services, manufacturing, as well as life and material science."
- dahfizz 6y agolarge datacenters have hardware orchestration systems that let them turn off unused machines. There really is no reason to have lots of machines on but unused. At least, that is not a significant enough event to be a determining factor in hardware purchasing.
- bostonsre 6y agoIf you are the one paying the electricity bills for that datacenter, then yes, it probably matters to you a lot. If you are just renting a server from aws or gcp, it probably matters less. Although, I assume costs born from idle inefficiency will probably be passed to the customer...
- deleted 6y ago[deleted]
- rbanffy 6y agoIf it has 80% of the performance, it will still be competitive at 80% of the price.
- ShroudedNight 6y agoThis sounds like a dangerous assumption to make. I would expect that needing 25% more machines for the same performance would be a non-starter for many potential customers.
- rbanffy 6y agoIf they still cost the same in the end, it’s still a tie. If you manage 100,000 machines, managing 125,000 is not a huge leap.
- throwaway888abc 6y agoWell, potentially 25000 machines more to fix
- rbanffy 6y agoJust factor that in the price.
- throwaway4good 6y agoI would expect most high-end servers in data centers to sit idle most of the time? Do you know of any data on this?
- jeffbee 6y agoCertainly for bit players and corporate datacenters with utilization < 1% you'd expect the median server to just sit there. For larger (amazon, google, etc) players the economic incentives against idleness are just too great.
- JoshTriplett 6y ago> For larger (amazon, google, etc) players the economic incentives against idleness are just too great. Not all workloads are CPU-bound. Cloud providers have many servers for which the CPUs are idle most of the time, because they're disk-bound, network-bound, other-server-bound, bursty, or similar. They're going to aim to minimize the idle time, but they can't eliminate it entirely given that they have customer-defined workloads.
- mamon 6y agoBut if the workload is not CPU-bound then why would they care about upgrading their CPUs to more performant ones, like Ice Lake Xeons?
- JoshTriplett 6y agoThe workloads are determined by their customers, and customers don't always pick the exact size system they need (or there isn't always an option for the exact size system they need). The major clouds are going to upgrade and offer faster CPUs as an option, people are going to use that option, and some of their workloads will end up idling the CPU. Major cloud vendors almost certainly have statistics for "here's how much idle time we have, so here's approximately how much we'd save with lower power consumption on idle".
- 6y ago
- neogodless 6y agoA bit off topic from the server CPU discussion, but I was curious how well AMD is advancing idle power consumption. For example, the Ryzen 3000 desktop chips seemed to have the issue[0], but the same Zen 2 cores seem to have found some improvements in the Ryzen 4000 mobile chips[1]. I didn't want to just rely on Reddit forum comments, so I found this measure of the Ryzen 3600[2]. > When one thread is active, it sits at 12.8 W, but as we ramp up the cores, we get to 11.2 W per core. The non-core part of the processor, such as the IO chip, the DRAM channels and the PCIe lanes, even at idle still consume around 12-18 W in the system. My interpretation was expect ~12 W or more idle consumption (just from the CPU package), but I'm not sure I understand it correctly. I couldn't find the same information for Ryzen 4000 laptops, but the same APU is tested in a NUC, where the total system draw (at the wall) at idle was about 10-11 W, still nearly double that of a Core i7 U-series NUC[3], but certainly lower than that of just the CPU package in the Ryzen 3600. Anecdotally, my 45W Ryzen 7 4800H laptop with 15.6" 1080p screen lasts about 4 hours on 80% of the 60Wh battery with 95% brightness, doing various non-intensive tasks. Though I don't know how well the battery holds up on complete non-use standby. [0] https://old.reddit.com/r/AMDHelp/comments/cfm1xa/why_is_ryzen_3000s_idle_power_consumption_so_high/ https://old.reddit.com/r/AMDHelp/comments/cfm1xa/why_is_ryze... [1] https://old.reddit.com/r/Amd/comments/haq4fg/the_idle_power_consumption_of_ryzen_4000_laptop/ https://old.reddit.com/r/Amd/comments/haq4fg/the_idle_power_... [2] https://www.anandtech.com/show/15787/amd-ryzen-5-3600-review-amazons-best-selling-cpu/2 https://www.anandtech.com/show/15787/amd-ryzen-5-3600-review... [3] https://www.anandtech.com/show/16236/asrock-4x4-box4800u-renoir-nuc-review/11 https://www.anandtech.com/show/16236/asrock-4x4-box4800u-ren...
- bkor 6y ago> I couldn't find the same information for Ryzen 4000 laptops I measured an Asus Mini PC PN50 with a Ryzen 4500U. The idle power usage was 8.5 Watt for the system. This with 32GB of memory and a SATA SSD installed. It would be nice if it was lower than this, but it isn't too bad. Interestingly the machine used 1.2 Watt while off after it wasn't on power, 0.5 Watt after starting up and shutting it down. Recently noticed some people focussing on low power but powerful 24/7 home "servers". Systems that are on 24/7, but often idle. One system used around 4.5 Watt in idle. The "brick" / power adapter often uses too much power, even when everything is off.
- Symmetry 6y agoI'm not sure that's a fair area comparison? AMD only has around 600 mm2 of expensive leading edge 7nm silicon and uses chiplets to up their yields. The rest is the connecting bits from an older and cheaper process. Intel's full size is a single monolithic die on a leading edge process.
- ineedasername 6y agoDo chiplets underperform compared to a monolithic die?
- wmf 6y agoYes.
- monocasa 6y agoPretty much any time you have signals going off chip, you lose out on both bandwidth and latency.
- Symmetry 6y agoAll things being equal a chiplet design will underperform a monolithic die. But we've already seen the benchmarks on the performance of Milan so looking at chiplets versus monolithic is mostly about considering AMD's strategy and constraints rather than how the chips perform.
- gsnedders 6y agoAs others have said, in isolation and perfect manufacturing capability, it's absolutely true a monolithic die is better. However, because each die is smaller, you can be more aggressive with your binning, potentially having a larger number of chips which you can bin into a higher frequency bucket. Ultimately, it's a matter of trade-offs, and what's right in one place might be wrong in another (see, e.g., AMD manufacturing mobile APUs on monolithic dies versus all their desktop and server parts using chiplets). We are seeing more of the industry moving to chiplets and similar solutions, notably Intel with their tiles.
- HelloNurse 6y ago
- monocasa 6y agoYou can't really compare die sizes of a MCM and a single die and expect to get transistor counts out of that. So much of the area of the MCM is taken up by all the separate phys to communicate between the chiplets and the I/O die, and the I/O die itself is on GF14nm (about equivalent to Intel 22nm) last time I checked, not a new competitive logic node. There's probably a few more gates still on the AMD side, but it's not the half again larger that you'd expect looking at area alone.
- marmaduke 6y agoIt's impressive how you and parent comment copied over to/from the dupe posting verbatim. edit oops nevermind, I see my comment was also mysteriously transported from the dupe.