3 ms·
Intel Brings a Big Fork to a Server CPU Knife Fight
- thiago_fm 2y agoIt's a tough period for Intel, there's new competition from all sides and it has slept on its success for too long, until Pat came aboard to shift things around. I believe that they did the right move by investing a lot in fabs. It takes many years to get them running and profitable, but then it's steady income. Now, on their processors business unit, it could be that they never manage to become the #1 again, but they could as well play the AMD strategy now, by selling cheaper hardware, and even eventually become a very small player in this market. It's also curious the other efforts, like their GPU with Battlemage, can they really catch up with decades and have a competitive product? It feels like building all the software needed to properly run games in a GPU like the Radeon or GeForce is a time consuming effort.
- FrostKiwi 2y agoAll these points are tough to predict for any industry player I think. Judging on whether they could become #1 again is only possible with insider information. All things considered I think their GPU efforts are very strong. The Hardware is competitive and the pace of improvement on the driver end was impressive, even if the initial showing was weak. They didn't drop Alchemist, they worked on it non till it became a viable option in its price class, even if a weak one. For a first showing, that is promising.
- oldpersonintx 2y ago[dead]
- paol 2y agoI have a pet theory that the recent focus on CPUs with a high count of low-perf cores (this article is about intel but AMD has an equivalent offering) is being driven by hyperscalers like Amazon and the perverse incentive caused by their pricing structures. Cloud providers have structured their compute offerings around dollars per core. This creates the incentive to deploy the densest possible core count processors, and zero incentive to make those cores faster. It can't have escaped people's notice how slow cloud VCPUs are. My 6 year old crappy laptop CPU has the same single core perf as a cloud instance that costs hundreds of dollars per month. And the frustration is not just cost, when you actually need good performance for something that doesn't scale so well horizontally, it's hard to get it.
- re-thc 2y ago> being driven by hyperscalers like Amazon and the perverse incentive caused by their pricing structures Not really. They can and do price it otherwise e.g. with different instance types. If we had to blame something then it's the move away from the traditional software licensing model. In the past, self-install software e.g. databases, OSes, etc would charge per core / CPU and that would be a huge chunk of the expenses added up. Now that we're free from this things are a lot different. Having said that, the desktop side is still aiming for high-perf cores for e.g. gaming. It's not lost - just harder and harder to do. > It can't have escaped people's notice how slow cloud VCPUs are It's not that slow. It comes down to choosing the right instances and staying current. EPYC 4th gen single core on e.g. Amazon i.e. c7a is not the same as a 6th year old laptop CPU? It's also not hundreds of dollars per month (reserved / spot instances are the way to go). Also this is nothing new. I remember the days of companies running their own VMWare data centers and those server Xeons were a lot slower. There are just heat and density concerns even if you had to do it yourself.
- paol 2y agoFunny enough c7a is just what we chose recently for our CI runners precisely because of the better CPU performance. It's only better relatively to the terribleness of the t* types though. And it definitely costs hundreds of dollars per month. Just ran the calculator and 8 VPCUs (to keep the rough laptop analogy) comes out at $316.
- re-thc 2y ago> It's only better relatively to the terribleness of the t* types though. It's never a value add to use the t* types. That's poor misinformation or at least outdated information that people keep spreading. The advantage of c7a or Graviton 3 though is you get real cores. Most of the t* get you vCPUs, and 1/2 of it are just threads. It can be up to 2x faster in that sense. > Just ran the calculator and 8 VPCUs (to keep the rough laptop analogy) comes out at $316. Does your laptop have 8 real cores not threads that can 24/7 keep its peak speeds? Most overheat and throttle... are we comparing the same thing? ??? USD? c7a.2xlarge (8 vCPU) spot instance pricing is $0.1032 = ~$80/month (us-east-1) Even on just a 3 year compute savings plan and we're on $144.71/month. You're not required to commit to a particular instance type - just the spending, so all good? This is excluding storage. Either way there's no reason to use EC2 On-Demand without a savings plan or spot. At least commit some of it a year and it's a big saving. Otherwise don't use AWS. Side note: EPYC 5th gen has been announced and we'll likely see way more improvements on top. Pricing will definitely go down. Also: this is just a rant on AWS. Hetzner, OVH or even Oracle cloud is way cheaper, like maybe 1/2 to 1/10 of this $316... it's not a cloud issue - just AWS.
- treprinum 2y agoAren't 288 cores with low cache going to be memory-starved with 12 channels?
- londons_explore 2y agomaybe being memory bandwidth starved is intentional? Cores are relatively cheap these days (not much silicon area, power proportional to instructions processed). Whereas cache uses a lot of silicon area (expensive), and memory bandwidth/data transfer costs power. Speculative memory reads trade lots of memory bus capacity and power for performance. Therefore, for maximum compute per watt and compute per dollar, you probably want excess cores and to make sure you fully utilize any cache and memory bandwidth. You don't do much speculative read-ahead and you accept lower per-core performance to get more throughput per dollar.
- treprinum 2y agoThat would be great for some homogeneous HPC workloads but I fail to see how that would help cloud providers renting individual cores, each on a different unrelated workload.
- londons_explore 2y ago> Intel will get its foundry sorted by 2025 or so I feel like I've been hearing similar things for the past decade...
- zer00eyz 2y agoI am rather excited for the all e-core chips. Web workloads: I just care about threads per core. Without hyper threading I can -- regain all the perf lost to heart bleed. -- Get near ARM like power performance. The servers with this chip will be able to put ram in the PCIe slots. You will be able to build for some interesting workloads (redid/valkey memory as cache/disk/table) Candidly with cloud costs being what they are, running your own hardware is having more appeal by the day.
- lionkor 2y agoI am not convinced the cloud was ever even remotely cheaper for compute than dedicated hardware.
- deleted 2y ago[deleted]