6 ms·
El Capitan: New supercomputer is the fastest
- Melatonic 2y agoAnybody know what "Inertial Confinement Fusion" is in the referenced article?
- JumpCrisscross 2y ago> what "Inertial Confinement Fusion" is The experimental fusion approach used by the NIF [1][2]. It's conveniently simultaneously an approach to fusion power, a way to study fusion plasmas and a tiny nuclear explosion. [1] https://en.wikipedia.org/wiki/Inertial_confinement_fusion https://en.wikipedia.org/wiki/Inertial_confinement_fusion [2] https://en.wikipedia.org/wiki/National_Ignition_Facility https://en.wikipedia.org/wiki/National_Ignition_Facility
- MobiusHorizons 2y ago> El Capitan, housed at Lawrence Livermore National Laboratory in Livermore, Calif., can perform over 2700 quadrillion operations per second at its peak. The previous record holder, Frontier, could do just over 2000 quadrillion peak operations per second. > El Capitan uses AMD’s MI300a chip, dubbed an accelerated processing unit, which combines a CPU and GPU in one package. In total, the system boasts 44,544 MI300As, connected together by HPE’s Slingshot interconnects. Seems like a nice win for AMD.
- alephnerd 2y ago> Seems like a nice win for AMD Yep! They've been part of the Exascale project for a long time, and it's good to see their commitment on HPC actually succeeded unlike Intel's during the same time period.
- einpoklum 2y agoSo, they built this supercomputer to test new and more deadly nuclear weapons. That makes me so "happy". I am absolutely not worried about two nuclear powers being close to the brink of direct war, even as we speak; nor about the abandonment of the course of nuclear disarmament treaty; nor about the repeated talk of a coming war against certain Asian powers. Everything is great and I'll just fawn over the colorful livery and the petaflops figure.
- comboy 2y agoI'd guess it's unlikely to be the real use case. The real one is classified. Plus it's not like more deadly nuclear weapons would change anything, we can do bad enough with what we already have.
- JumpCrisscross 2y ago> it's unlikely to be the real use case. The real one is classified. What are you basing this on? > it's not like more deadly nuclear weapons would change anything We haven't been chasing yield in nuclear weapons since the 60s. Our oldest warheads date from the 60s [1]. For obvious reasons, the experimental track record on half-century old pits is scarce. We don't know if novel physics or chemistry is going on in there, and we don't want to be the second ones to find out. [1] https://en.wikipedia.org/wiki/B61_nuclear_bomb https://en.wikipedia.org/wiki/B61_nuclear_bomb
- alephnerd 2y ago> I'd guess it's unlikely to be the real use case I can safely say that nuclear simulations are one of the major drivers for HPC research globally. It is not the only one (genomics, simulations, fundamental research are also major drivers) but it is a fairly prominent one.
- realo 2y agoMaybe there is research not on bigger bangs, but on smaller packages? Think about a baseball-size device able to take out a city block. Then think about an escadron of drones able to transport those baseballs to very precise city blocks...
- JumpCrisscross 2y ago> they built this supercomputer to test new and more deadly nuclear weapons If you are afraid of nuclear war, the thing to fear is a nuclear state's capacity to retaliate being questioned. These supercomputers are the alternative to live tests. Taking them away doesn't poof nuclear weapons, it means you are left with a half-assed deterrent or must resume live tests. > the abandonment of the course of nuclear disarmament treaty North Korea, the American interventions in the Middle East and Ukraine set the precedent that nuclear sovereignty is in a separate category from the treaty-enforced kind. Non-proliferation won't be made or broken on the back of aging, degrading weapons. > repeated talk of a coming war against certain Asian powers One invites war by refusing to prepare for it.
- olao99 2y agoI fail to understand how these nuclear bomb simulations require so much compute power. Are they trying to model every single atom? Is this a case where the physicists in charge get away with programming the most inefficient models possible and then the administration simply replies "oh I guess we'll need a bigger supercomputer"
- TeMPOraL 2y agoPot, meet kettle? It's usually the industry that's leading with "write inefficient code, hardware is cheaper than dev time" approach. If anything, I'd expect a long-running physics research project to have well-optimized code. After all, that's where all the optimized math routines come from.
- glial 2y agoI bet the bulk of it is still super-fast Fortran code.
- bongodongobob 2y agoMy brother in Christ, it's a supercomputer. What an odd question.
- CapitalistCartr 2y agoIt's because of the way the weapons are designed, which requires a CNWDI clearance to know, so your curiosity is not likely to be sated.
- nordsieck 2y ago> It's because of the way the weapons are designed, which requires a CNWDI clearance to know, so your curiosity is not likely to be sated. While that's true, the information that is online is surprisingly detailed. For example, this series "Nuclear 101: How Nuclear Bombs Work" https://www.youtube.com/watch?v=zVhQOhxb1Mc https://www.youtube.com/watch?v=zVhQOhxb1Mc https://www.youtube.com/watch?v=MnW7DxsJth0 https://www.youtube.com/watch?v=MnW7DxsJth0
- cryptozeus 2y agoThis is great but I absolutely love that poster of el capitan on the supercomputer racks ! Also TIL there is a list of top500 at https://www.top500.org/lists/top500/2024/11/ https://www.top500.org/lists/top500/2024/11/
- theideaofcoffee 2y agoThat's a pretty standard Cray feature for systems larger than a few cabinets. El Capitan has the landscape, Hopper at NERSC had a photo of Grace Hopper, Aurora at ANL has a creamy gradient reminiscent of the Borealis, and on and on. Gives them a bit of character beyond the bad-ass Cray label on the doors.
- qingcharles 2y agoI've always loved these charts. The Numerical Wind Tunnel, #1 in 1993, achieved 124.2 gigaflops on the Linpack benchmark. In comparison, the iPhone 15 Pro Max cellphone, released in 2023, delivers approximately 2150 gigaflops. I once drew the chart backwards. I think my PC in 2013 would have been the fastest on Earth in 1990. And faster than every computer combined in about 1982.[0] [0] might not be accurate
- mmoskal 2y ago2Tflops was #500 in 2006. Still a supercomputer. Crazy. https://www.top500.org/statistics/perfdevel/ https://www.top500.org/statistics/perfdevel/
- adrian_b 2y agoThose Gflop/s quoted for the iPhone must be FP32 Gflop/s. The Gflop/s quoted in the past for supercomputers and now for big HPC clusters are FP64 Gflop/s. The difference in cost between FP64 and FP32 is currently extremely high, much higher than it has ever been in the history of computer technology. The reason is not technical, but of market segmentation, because NVIDIA, then also AMD, have removed the ability to do FP64 operations at a competitive rate from their "consumer" GPUs, so the best that one can get in performance per dollar is AMD 9950X (which can approach 2 FP64 Tflop/s per CPU, i.e. 256 FP64 FMA per clock cycle multiplied by around 4 GHz, with 2 flops per FMA).
- pama 2y agoNoting here that 2700 quadrillion operations per second is less than the estimated sustained throughput of productive bfloat16 compute during the training of the large llama3 models, which IIRC was about 45% of 16,000 quadrillion operations per second, ie 16k H100 in parallel at about 0.45 MFU. The compute power of national labs has fallen far behind industry in recent years.
- alephnerd 2y agoTraining an LLM (basically Transformers) is different workflow from Nuclear Simulations (basically Monte Carlo simulations) There are a lot of intricates, but at a high level they require different compute approaches.
- handfuloflight 2y agoCan you expand on why the operations per second is not an apt comparison?
- pertymcpert 2y agoWhen you're doing scientific simulations, you're generally a lot more sensitive to FP precision than ML training which is very, very tolerant of reduced precision. So while FP8 might be fine for transformer networks, it would likely be unacceptably inaccurate/unusable for simulations.
- pama 2y agoAbsolutely. Though the performance of El Capitain is only measured by a linpack benchmark not the actual application.
- pertymcpert 2y agoI thought modern supercomputers use benchmarks like HPCG instead of LINPACK?
- 2y ago
- declan_roberts 2y agoDo super computers need proximity to other compute nodes in order to perform this kind of computations? I wonder what would happen if Apple offered people something like iCloud+ in exchange for using their idle M4 compute at night time for a distributed super computer.
- conception 2y agoIf you weren’t aware - https://en.m.wikipedia.org/wiki/Folding@home https://en.m.wikipedia.org/wiki/Folding@home
- declan_roberts 2y agoMore of a SETI@home man myself.
- theideaofcoffee 2y agoThe thing that sets these machines apart from something that you could set up in AWS (to some degree), or in a distributed sense like you're suggesting is the interconnect, how the compute nodes communicate. For a large system like El Capitan, you're paying a large chunk of the cost in connecting the nodes together, low latency, interesting topologies that ethernet, nor even Infiniband can get close to. Code that requires a lot of DMA or message passing really will take up all of the bandwidth that's available, that becomes the primary bottleneck in these systems. The interconnect has been Cray's bread and butter for multiple decades: Slingshot, Dragonfly, Aries, Gemini, SeaStar, numalink via sgi, etc. and those for the less massively parallel systems before those.
- sliken 2y agoI've seen nothing showing that slingshot has any particular advantage over IB for HPC. Sure HPE pushes slingshot (an HPE interconnect) over giving bags of money to Nvidia, but that's a business decisions. Eagle (the #4 cluster on the list) is Infiniband NDR. I believe 306 of the top 500 clusters used Infiniband. Pretty sure the advance topologies like dragonfly are supported on IB as well as Slingshot. From what I can tell slingshot is much like ultra ethernet, trying to take the best of IB and ethernet and making a new standard. From what I can tell slingshot 11 latency is much like I got with omnipath/pathscale way back when dual core opterons were the cutting edge.
- balia 2y agoSome may not want to hear this, but these “fastest supercomputer” list is now meaningless because all the Chinese labs have started obfuscating their progress. A while ago there were a few labs in China in top 10 and they all attracted sanctions / bad attention. Now no Chinese lab report any data now
- pknomad 2y agoI wouldn't say meaningless... just incomplete.
- leptons 2y agoI doubt the US Government is telling everyone about their fastest computer.
- grapesodaaaaa 2y agoThe DOE has entered the chat. (after the nuclear test ban treaty, they run a LOT of simulations)
- buildbot 2y agoIsn't that the open secret for El Cap? "Classified workloads" aka weapons sims.
- sliken 2y agoNot a secret, from IEEE: The NNSA—which oversees Lawrence Livermore as well as Los Alamos National Laboratory and Sandia National Laboratories—plans to use El Capitan to “model and predict nuclear weapon performance, aging effects, and safety,”
- leptons 2y agoThere's no real secret about nuclear weapons simulations. Sure the software they use is protected and "secret", but the real secret computing facilities are likely there to break encryption and spy on everyone. Nuclear weapons simulations don't really give the US a tactical advantage, but breaking encryption does, and so that kind of compute power would be kept secret.
- sandworm101 2y agoThis new upstart to the name may win in search results today, but in a few years the first and true El Cap will reclaim its place. It will outlast all of us. https://en.wikipedia.org/wiki/El_Capitan https://en.wikipedia.org/wiki/El_Capitan
- teleforce 2y agoFun facts, FFT was discovered back in 1965 based on the urgent necessity of discovering and detecting illegal nuke testing activities, just two years after the Partial Test Ban Treaty (PTBT) was signed in 1963 [1]. The first sentence statement in the article mentioning that United States and other nuclear powers committed to the Comprehensive Nuclear-Test-Ban Treaty in 1965 is wrong since the treaty was only signed in 1996 not in 1965 [2]. [1] The Algorithm That Almost Stopped The Development Of Nuclear Weapons: https://www.iflscience.com/the-algorithm-that-almost-stopped-the-development-of-nuclear-weapons-67750 https://www.iflscience.com/the-algorithm-that-almost-stopped... [2] The Comprehensive Nuclear-Test-Ban Treaty: https://www.ctbto.org/our-mission/the-treaty https://www.ctbto.org/our-mission/the-treaty
- sliken 2y agoAnother fun fact, the priority for detecting nuclear testing led to seisometers all over the planet. So the detection the exact position and nature of any disturbance on the planet became radically better. This was quite the boon to anyone interested in earthquakes, not only can the earth quake be detected in 2D, but accurately in 3D. The number and accuracy is enough you can see where on each fault is, the thickness of the crust, and the outline of subduction zones in 3d. Pretty crazy to see enough detail to see where plates enter the mantle and melts. Said sensors can also track sonic booms from secret supersonic planes, but governments don't like to talk about that.
- johnisgood 2y agoCool factoids! If you have any more to share, please do so.
- LargoLasskhyfv 2y agoNot OP, but maybe he was referring to https://duckduckgo.com/secret+plane+supersonic+booms+nevada+seismic https://duckduckgo.com/secret+plane+supersonic+booms+nevada+... leading to https://www.latimes.com/archives/la-xpm-1992-04-17-me-607-story.html https://www.latimes.com/archives/la-xpm-1992-04-17-me-607-st... amongst others.
- YellLetters 2y ago[dead]
- tuananh 2y agoThis is a major milestone for Oxide Computer team. Congrats
- vmilner 2y agoI remember porting code from 32-bit address spaces to 64-bit ones in the 90s and thinking 2^64 was “Kind of infinite” - but this machine does 2^64 operations in 8 seconds…