7 ms·

> 27,648 Nvidia Tesla V100 GPU modules holy shit

by taliesinb 8y ago

dogma1138 8y ago
I always wondered what’s the bulk discount on these since it’s north of $200,000,000 for GPUs alone.
- tempdeadbeef 8y ago
  Bulk discount when currency miners will pay full price?
  - quadruplebond 8y ago
    Nvidia was probably under contract for this before mining blew up to where it is today. Provisioning for these machines starts 5-10 years before they ever come online.
  - dogma1138 8y ago
    This is a product that is only available from NVIDIA directly there is zero mining pressure on this specific product and channel.
- IncRnd 8y ago
  I'm not sure you can get a discount for any purchase, since 100% will be sold anyway.
  - dboreham 8y ago
    In high volume you cut out various middlemen so the price can be lower while the per-die revenue remains the same.
    - ianai 8y ago
      There’s still something to be said for inherent price insensitivity for the national labs.
    - dogma1138 8y ago
      There isn’t a middleman for this configuration you can only get the NVLINK ones from NVIDIA.
      - dboreham 8y ago
        I don't know for sure obviously, but based on my time in the semiconductor industry they will force lower volume sales through distribution (even if the part is not generally available). This is for financial risk and supply chain reasons (e.g. RMAs, shipping/customs/tax/duty).
    - deleted 8y ago
      [deleted]
- gh02t 8y ago
  This article suggests that Summit cost somewhere in the low $100 million range and last I heard from DoE that was accurate, so they aren't exactly paying retail. https://www.nextplatform.com/2016/11/20/details-emerge-summit-power-tesla-ai-supercomputer/ https://www.nextplatform.com/2016/11/20/details-emerge-summi... Price isn't really a concern with these computers, though, because the sort of experimental work they are intended to "replace" (using that loosely, since a lot of the things they simulate are impossible to actually do) is far more expensive. Leadership-grade computing is all about enabling new classes of problems to be solved.
  - civilitty 8y ago
    Regardless of the leadership position, most of the time a bunch of money can be allocated from nuke maintenance budgets. Maintaining a massive nuclear arsenal without testing requires a ton of computing power and the cost of upgrading supercomputers a few times a decade is a rounding error.
    - gh02t 8y ago
      Summit is an open science machine (meaning any researcher can apply for time, but it's very competitive so getting an allocation is difficult) and is not budgeted to NNSA for stockpile maintenance as far as I know. It should be running mostly non-classified scientific research, though there is a provision for running sensitive research like stuff related to operating nuclear plants. Sierra at LLNL is the one that is primarily targeted towards classified weapons-related research and NNSA operates independently within DoE.
      - civilitty 8y ago
        It's not budgeted for it but I heard that some of the FastForward 2 program money ended up going to ORNL because NNSA needed to do some early stage verification that was prohibitively expensive for them to do on their own but trivial for Summit (since they were already getting the hardware). AFAIK there isn't a single publicly owned supercomputer in the US that wasn't funded in small part by stockpile maintenance budgets, even if they were never used for that purpose.

> 27,648 Nvidia Tesla V100 GPU modules holy shit

dogma1138 8y ago

I always wondered what’s the bulk discount on these since it’s north of $200,000,000 for GPUs alone.

tempdeadbeef 8y ago
Bulk discount when currency miners will pay full price?
- quadruplebond 8y ago
  Nvidia was probably under contract for this before mining blew up to where it is today. Provisioning for these machines starts 5-10 years before they ever come online.
- dogma1138 8y ago
  This is a product that is only available from NVIDIA directly there is zero mining pressure on this specific product and channel.
IncRnd 8y ago
I'm not sure you can get a discount for any purchase, since 100% will be sold anyway.
- dboreham 8y ago
  In high volume you cut out various middlemen so the price can be lower while the per-die revenue remains the same.
  - ianai 8y ago
    There’s still something to be said for inherent price insensitivity for the national labs.
  - dogma1138 8y ago
    There isn’t a middleman for this configuration you can only get the NVLINK ones from NVIDIA.
    - dboreham 8y ago
      I don't know for sure obviously, but based on my time in the semiconductor industry they will force lower volume sales through distribution (even if the part is not generally available). This is for financial risk and supply chain reasons (e.g. RMAs, shipping/customs/tax/duty).
  - deleted 8y ago
    [deleted]
gh02t 8y ago
This article suggests that Summit cost somewhere in the low $100 million range and last I heard from DoE that was accurate, so they aren't exactly paying retail. https://www.nextplatform.com/2016/11/20/details-emerge-summit-power-tesla-ai-supercomputer/ https://www.nextplatform.com/2016/11/20/details-emerge-summi... Price isn't really a concern with these computers, though, because the sort of experimental work they are intended to "replace" (using that loosely, since a lot of the things they simulate are impossible to actually do) is far more expensive. Leadership-grade computing is all about enabling new classes of problems to be solved.
- civilitty 8y ago
  Regardless of the leadership position, most of the time a bunch of money can be allocated from nuke maintenance budgets. Maintaining a massive nuclear arsenal without testing requires a ton of computing power and the cost of upgrading supercomputers a few times a decade is a rounding error.
  - gh02t 8y ago
    Summit is an open science machine (meaning any researcher can apply for time, but it's very competitive so getting an allocation is difficult) and is not budgeted to NNSA for stockpile maintenance as far as I know. It should be running mostly non-classified scientific research, though there is a provision for running sensitive research like stuff related to operating nuclear plants. Sierra at LLNL is the one that is primarily targeted towards classified weapons-related research and NNSA operates independently within DoE.
    - civilitty 8y ago
      It's not budgeted for it but I heard that some of the FastForward 2 program money ended up going to ORNL because NNSA needed to do some early stage verification that was prohibitively expensive for them to do on their own but trivial for Summit (since they were already getting the hardware). AFAIK there isn't a single publicly owned supercomputer in the US that wasn't funded in small part by stockpile maintenance budgets, even if they were never used for that purpose.