4 ms·

New breed of supercomputer aims for the two quintillion mark

19 points by wallflower 3y ago

deleted 3y ago
[deleted]
latchkey 3y ago
@dang paywalled to the point that even archive can't get through to it.
- classified 3y ago
  It was to be expected that the arms race would reach this point. Here's to extreme copyrightism.
- timbit42 3y ago
  I can see it fine using the Bypass Paywalls Clean web browser add-on.
  - latchkey 3y ago
    Wild. I run that too, latest main, and I still can't see it.
    - timbit42 3y ago
      Hmm. Perhaps it has to do with another add-on I'm using.
defrost 3y ago
Meanwhile, in sources that are not the WSJ: Aurora (supercomputer) https://en.wikipedia.org/wiki/Aurora_(supercomputer) https://en.wikipedia.org/wiki/Aurora_(supercomputer) New exascale machine is one step closer to enabling transformative science https://news.uchicago.edu/story/argonne-installs-final-components-aurora-supercomputer https://news.uchicago.edu/story/argonne-installs-final-compo... Intel Unveils Full Aurora Supercomputer Specifications: 21,248 Xeon CPUs & 63,744 GPUs For Over 2 ExaFlops https://wccftech.com/intel-unveils-aurora-supercomputer-specifications-21248-xeon-cpus-63744-gpus-for-over-2-exaflops/ https://wccftech.com/intel-unveils-aurora-supercomputer-spec... Argonne Leadership Computing Facility https://www.alcf.anl.gov/aurora https://www.alcf.anl.gov/aurora
derac 3y ago
Is there a source for the largest privately held supercomputers? This article, for instance, claims that Tesla had a 1.8 exaflop cluster in 2021. It also mentions Karpathy claiming it to be the 5th largest at the time. https://blogs.nvidia.com/blog/tesla-av-training-supercomputer-nvidia-a100-gpus/ https://blogs.nvidia.com/blog/tesla-av-training-supercompute...
- boulos 3y ago
  I think anyone can get on the Top 500 as long as they run a verified FP64 LINPACK result. At the time, this would have been comparing against Perlmutter: https://www.top500.org/lists/top500/2021/06/ https://www.top500.org/lists/top500/2021/06/ So 6k A100s at just under 10 TFlops of FP64 => 60 PFlops. I don't remember if they said what the interconnect was, as that can hold you back from achieving those 60-ish PFlops. It's too bad NVIDIA's blog referred to the FP16 value as "flops" in the same breath, as most people at NVIDIA know that Top500 focuses on achieved FP64 LINPACK results. I swear there was some talk of using MLperf or similar to make a Top500-for-ML/reduced precision, but can't find it now.

19 points by wallflower 3y ago

deleted 3y ago

[deleted]

latchkey 3y ago

@dang paywalled to the point that even archive can't get through to it.

classified 3y ago
It was to be expected that the arms race would reach this point. Here's to extreme copyrightism.
timbit42 3y ago
I can see it fine using the Bypass Paywalls Clean web browser add-on.
- latchkey 3y ago
  Wild. I run that too, latest main, and I still can't see it.
  - timbit42 3y ago
    Hmm. Perhaps it has to do with another add-on I'm using.

defrost 3y ago

Meanwhile, in sources that are not the WSJ: Aurora (supercomputer) https://en.wikipedia.org/wiki/Aurora_(supercomputer) https://en.wikipedia.org/wiki/Aurora_(supercomputer) New exascale machine is one step closer to enabling transformative science https://news.uchicago.edu/story/argonne-installs-final-components-aurora-supercomputer https://news.uchicago.edu/story/argonne-installs-final-compo... Intel Unveils Full Aurora Supercomputer Specifications: 21,248 Xeon CPUs & 63,744 GPUs For Over 2 ExaFlops https://wccftech.com/intel-unveils-aurora-supercomputer-specifications-21248-xeon-cpus-63744-gpus-for-over-2-exaflops/ https://wccftech.com/intel-unveils-aurora-supercomputer-spec... Argonne Leadership Computing Facility https://www.alcf.anl.gov/aurora https://www.alcf.anl.gov/aurora

derac 3y ago

Is there a source for the largest privately held supercomputers? This article, for instance, claims that Tesla had a 1.8 exaflop cluster in 2021. It also mentions Karpathy claiming it to be the 5th largest at the time. https://blogs.nvidia.com/blog/tesla-av-training-supercomputer-nvidia-a100-gpus/ https://blogs.nvidia.com/blog/tesla-av-training-supercompute...

boulos 3y ago
I think anyone can get on the Top 500 as long as they run a verified FP64 LINPACK result. At the time, this would have been comparing against Perlmutter: https://www.top500.org/lists/top500/2021/06/ https://www.top500.org/lists/top500/2021/06/ So 6k A100s at just under 10 TFlops of FP64 => 60 PFlops. I don't remember if they said what the interconnect was, as that can hold you back from achieving those 60-ish PFlops. It's too bad NVIDIA's blog referred to the FP16 value as "flops" in the same breath, as most people at NVIDIA know that Top500 focuses on achieved FP64 LINPACK results. I swear there was some talk of using MLperf or similar to make a Top500-for-ML/reduced precision, but can't find it now.