6 ms·

It’s unbelievable stuff. Does anyone know how much a single box costs? They are selling them it looks like.

sbierwagen 4y ago
CS-1 costs "$2-3 million", CS-2 costs "several" million. A single Nvidia H100 costs somewhere around $30,000 each, so a GPU server with every slot populated costs about $300,000.
- brucethemoose2 4y ago
  ServeTheHome claims "HGX A100 platforms, when they are sold as single servers are generally in the $130K-$180K even leaving a very healthy margin for OEMs/ resellers" https://www.servethehome.com/graphcore-celebrates-a-stunning-loss-at-mlperf-training-v1-0/2/ https://www.servethehome.com/graphcore-celebrates-a-stunning... Not sure about the H100, but it seems to be more supply constrained (hence pricier) atm. Now, the real question is how many HGX nodes "equals" a single CS2 node. The math here is extremely fuzzy, as the benefit to such extreme node consolidation depends on the workload, and the CS-2 takes up less space, but the HGX cluster will have more directly accessible RAM and better turnkey support for stuff since its Nvidia.
bubblethink 4y ago
There is cloud pricing on the website. https://www.cerebras.net/product-cloud/ https://www.cerebras.net/product-cloud/
- alchemist1e9 4y ago
  This is actually really important from my perspective. It looks like an end user can work backwards from available inference hardware, or interference budget, required speed, then figure out a viable model size. Bring their own data and then fine tune or train from scratch. This is getting so real so fast.
freeqaz 4y ago
If you have to ask, you can't afford it! Mostly teasing but my guess would be $500k+ since they'll likely price it so that it is the same $ as the equivalent NVIDIA cluster (or very close to it).
- alchemist1e9 4y ago
  Actually if they are around $2M looks like my company can afford one. Given this is just getting started it looks promising as I’m sure future generations will be more affordable.
ericd 4y ago
On the order of several million USD for the second gen system. Last I heard, they’re still at lowish volumes, selling some to national labs and the like.

CS-1 costs "$2-3 million", CS-2 costs "several" million. A single Nvidia H100 costs somewhere around $30,000 each, so a GPU server with every slot populated costs about $300,000.

brucethemoose2 4y ago
ServeTheHome claims "HGX A100 platforms, when they are sold as single servers are generally in the $130K-$180K even leaving a very healthy margin for OEMs/ resellers" https://www.servethehome.com/graphcore-celebrates-a-stunning-loss-at-mlperf-training-v1-0/2/ https://www.servethehome.com/graphcore-celebrates-a-stunning... Not sure about the H100, but it seems to be more supply constrained (hence pricier) atm. Now, the real question is how many HGX nodes "equals" a single CS2 node. The math here is extremely fuzzy, as the benefit to such extreme node consolidation depends on the workload, and the CS-2 takes up less space, but the HGX cluster will have more directly accessible RAM and better turnkey support for stuff since its Nvidia.

bubblethink 4y ago

There is cloud pricing on the website. https://www.cerebras.net/product-cloud/ https://www.cerebras.net/product-cloud/

alchemist1e9 4y ago
This is actually really important from my perspective. It looks like an end user can work backwards from available inference hardware, or interference budget, required speed, then figure out a viable model size. Bring their own data and then fine tune or train from scratch. This is getting so real so fast.

freeqaz 4y ago

If you have to ask, you can't afford it! Mostly teasing but my guess would be $500k+ since they'll likely price it so that it is the same $ as the equivalent NVIDIA cluster (or very close to it).

alchemist1e9 4y ago
Actually if they are around $2M looks like my company can afford one. Given this is just getting started it looks promising as I’m sure future generations will be more affordable.

ericd 4y ago

On the order of several million USD for the second gen system. Last I heard, they’re still at lowish volumes, selling some to national labs and the like.