5 ms·
Who are AMD, Intel's new manycore monster CPUs for?
- vlovich123 2y agoTLDR: As you’d expect hyperscalers.
- physicsguy 2y agoSupercomputers? I've done work on 192-core machines in the past doing MPI jobs.
- bee_rider 2y agoIt is crazy how few MPI processes it takes to get to 1000 cores now, haha.
- highfrequency 2y agoWhat is MPI?
- bee_rider 2y agoMessage Passing Interface. It is a very popular API for distributed computing, particularly in the scientific computing/hpc world.
- dorfsmay 2y agohttps://en.wikipedia.org/wiki/Message_Passing_Interface https://en.wikipedia.org/wiki/Message_Passing_Interface
- porcoda 2y agoDistributed memory parallel computing library. Most common in supercomputers with a high performance interconnect where you want to run one program that coordinates separate instances of itself via message passing (“SPMD” - single program multiple data parallelism). Slightly different than distributed computing that generally doesn’t assume a tightly coupled system with a low latency, high bandwidth interconnect. Allows you to scale up beyond what you can do within shared memory spaces where you are limited to low core counts (hundreds) and low memory (<1TB) - MPI is what you use when you’re in the many thousands of cores, many TB of RAM regime. In practice, supercomputers require a mixture: shared memory for many core parallelism, some hybrid host programming model for bringing accelerators in, and then MPI to coordinate between these shared memory/accelerator enabled hosts.
- CaliforniaKarl 2y agoSupercomputers, yes, but also genomics workloads. The vast majority of those workloads are effectively tied to one machine, since they don’t support cross-machine scaling, nor things like MPI.
- Jtsummers 2y agoDo they not support MPI and scaling across machines because of the features of the workloads or because of the features of the systems performing the work? If the latter, then maybe they can use multiple cores using things like OpenMP and the like to get some "free" scaling, but they could be made to work with MPI or across machines. However, if it's the former, more cores won't help them.
- NGRhodes 2y agoAs a fresh example, we (a University) have just this month had delivered about 9000 cores (and about 80 GPUs) of machines, these are being added to our existing 6000 cores (approx 5 year old) machines. This is a modest HPC system.
- m463 2y agomake -j$(nproc)
- bhaney 2y agoMe
- fhdsgbbcaA 2y agoLikewise, and I will USE all the cores @ 100%, as The Good Lord commanded.
- bhouston 2y agoYeah, they are mostly for cloud providers. They will be running all of our docker containers and Kubernetes clusters and function as a service workflows as well as our databases. It really should mean that cloud data centres should be able to greatly increase capacity without getting larger in terms of physical size. That is a huge net win for the cloud providers.
- mikepurvis 2y agoI assume you end up getting bottlenecks to RAM, disk, and network when there’s this much parallelism in CPU. So even for cloud providers it’s probably most suited to some fairly specific CPU-heavy workloads.
- adgjlsfhk1 2y agoyou're under-estimating the power of 512 mb of cache, 12 channel ddr5, pcie 5 NVMEs and 880GB/s networking cards. The giant L3 cache means that memory pressure is significantly reduced (especially if many of the cores use similar data). Ram is the weakest link here (12 channels of ddr5 6000 is a ton from a consumer standpoint, but scaling up from dual channel on a 16 core cpu would only bring you up to 96 cores). The 128 lanes of PCIE though means that you don't have much bottleneck outside of ram (if you're doing things properly). If you use 64 of those for storage, that can be 100s of TB of ridiculously fast storage, and you still have another 64 left over for ridiculously fast networking.
- everforward 2y agoIn the cloud vendor space (and really virtualization in general) local disk is practically non-existent. The vast majority of apps these days are stateless and generate very little IO, and even if they do generate IO, it's more than likely going to some kind of network share so that the VM can fail over. If the VM's data is on local disk, you can't migrate it to a new host if the host it's on dies (along with its local disks). Presuming the other responder is correct about there being 880GB/s of network cards (and that the units are correct at GB/s instead of Gb/s or Gbps), that should be more than plenty. At the largest CPUs, 192 cores would be 4.5 GB/s per core (2.3 GB/s if dual socket). That's more than enough; I see a lot of dual-socket servers with 24 or so total cores running on 10 Gbps or maybe bonded 10 Gbps. That's about 100 MB/s per core.
- mbrumlow 2y agoMe? I compile most of my OS and I would like it faster. I also like being able to compile and game at the same time. Or run many OSs in VMs at the same time.
- shepherdjerred 2y agoSo many developer workloads can be sped up significantly by throwing more cores at the problem. Classic examples are compilation and linting, but even unit/integration/end-to-end testing can be made feasible locally if you have a strong machine and architect your tests properly. I’ve done this before with the testcontainers library and it enables some really nice workflows.
- stouset 2y agoHonest question: what do you actually accomplish by compiling your OS?
- homarp 2y agosee https://old.reddit.com/r/linux4noobs/comments/9tsaxl/why_does_gentoo_compile_everything/ https://old.reddit.com/r/linux4noobs/comments/9tsaxl/why_doe...
- bravetraveler 2y agoI want to get this out first: an OS is not a single unit. It is a collection of parts. Operating... System. With that out of the way, modification! It actually becomes my OS, not at the mercy of The Build or provider. Licensing gets tricky here. You have to be careful if intending to redistribute the work. Open source allows you to compile and not care about much else for your use. The code lets you do what you want or need. Compiled binaries limit your options, one can't as readily change them or find what they do. Imagine BigCo gives you something to support a widget or tool you use. Nay, need. It stops working, the job is no longer being done. What do you do? What you can or what they allow. While everyone may not do this, they absolutely benefit from the ability. Many compile simply to get the most-representative CPU optimizations. See '-march=native', for example. Binary distributions have to make assumptions. Compiling source lets you correct them. On the Linux side I prefer Fedora. Binary distribution with excellent packaging tools. I can rebuild anything with the same commands, but rarely have to. Good defaults with build options and patches.
- wyldfire 2y agoIt's tremendously difficult to keep 192 cores truly busy at the same time. Unless you have enormous caches and enormous memory throughput, that is.
- c2h5oh 2y agoThat 192 core CPU comes with 12 ddr5 memory channels up to 6000mt/s - test results show 420-450 GB/s for both reads and writes.
- bubaumba 2y agoNVidia should be afraid. Same GB/s on CPU are much more than on GPU. The problem here will be the price of the whole system. Anyway it's a step in the right direction if we want something like Copilot on premises or at home.
- exceptione 2y agoJust curious, much more what?
- janwas 2y agoMost of the SIMD code I write can consume tens of GB/s BW per core. From this perspective, it seems that 192 cores make for an imbalanced system.
- bubaumba 2y agoDon't worry, 20 year back most people had no clue how to use the second core. They believed in GHz and when it became obvious the theoretical limit is close thought that's the end of evolution.
- Jtsummers 2y agoPeople knew how to use the second core 20 years ago, SMP machines had been around for decades by that point. For the most part, the second core was taken care of by the OS which already had support for those SMP systems, and using multithreading or multiprocessing workloads.
- noizejoy 2y agoI’m fascinated by the idea of my future music making DAW computer having one of those manycore monsters. That’s also because my favourite software synthesizers are increasingly modelling instruments, rather than sample based instruments. And that reduces the need for RAM and storage, but increases the thirst for CPU cycles.
- andrewstuart 2y agoMe. The more CPU the better for all my systems.
- peutetre 2y agoVideo encoding. To get the best quality for bitrate you need to use a software encoder, and to get the best encode time you need to give it CPU resources. It's been impressive how much SVT-AV1 has increased performance between releases. SVT-AV1 2.2 is a significant step up from 2.1: https://www.phoronix.com/news/SVT-AV1-2.2-Released https://www.phoronix.com/news/SVT-AV1-2.2-Released https://gitlab.com/AOMediaCodec/SVT-AV1 https://gitlab.com/AOMediaCodec/SVT-AV1
- deleted 2y ago[deleted]
- bubblesnort 2y agoI wonder how hard it is to kill a fork bomb with 192 cores running full blast.
- teleforce 2y agoImagine one of this 128-core CPUs utilizing several TBs of RAM connected via CXL and several PBs of storage combine with real-time Linux, and I'm in software-defined-X (SD-x for SDN, SDR, etc) workstation wonderland [1], [2]. [1] Samsung Unveils CXL Memory Module Box: Up to 16 TB at 60 GB/s: https://www.anandtech.com/show/21333/samsung-unveils-cxl-memory-module-box-up-to-16-tb-at-60-gbs https://www.anandtech.com/show/21333/samsung-unveils-cxl-mem... [2] Huawei unveils its OceanStor A800 AI-specific storage solution; announces 128TB high-capacity SSD https://www.datacenterdynamics.com/en/news/huawei-unveils-its-oceanstor-a800-ai-specific-storage-solution-announces-128tb-high-capacity-ssd/ https://www.datacenterdynamics.com/en/news/huawei-unveils-it... [3] Real-time Linux is officially part of the kernel: https://news.ycombinator.com/item?id=41594862 https://news.ycombinator.com/item?id=41594862
- dagurp 2y agoimagine a Beowulf cluster of those
- credit_guy 2y agoIt looks to me Intel will cannibalize its older, 5th, generation Xeon processors. Here's a comparison of two 64 core processors, one is 5th generation, launched in Q4 '23 [1], and one is 6th generation, launched in Q2 '24 [2]. The first one as an MSRP of $12400 (not a mistake) and the second $2749. It is true that the 5th generation CPU has 128 threads, vs only 64 for the 6th generation, but is this worth a price premium of 350% ? [1] https://www.intel.com/content/www/us/en/products/sku/237252/intel-xeon-platinum-8593q-processor-320m-cache-2-20-ghz/specifications.html https://www.intel.com/content/www/us/en/products/sku/237252/... [2] https://www.intel.com/content/www/us/en/products/sku/240363/intel-xeon-6710e-processor-96m-cache-2-40-ghz/specifications.html https://www.intel.com/content/www/us/en/products/sku/240363/...