4 ms·

What boards specifically are you talking about re: 4 GPUs (either 16/8/8/8 or 16/16/16/16)

jacquesm 9y ago
Asus X99-E WS is a good starting point. You can put four double wide GPUs on that. Another really nice one is this one: https://www.supermicro.nl/Aplus/system/Tower/4021/AS-4021GA-62R_F.cfm https://www.supermicro.nl/Aplus/system/Tower/4021/AS-4021GA-... (AMD based) https://www.supermicro.nl/products/system/4U/7047/SYS-7047GR-TRF.cfm https://www.supermicro.nl/products/system/4U/7047/SYS-7047GR... (Intel based) http://www.dell.com/us/business/p/poweredge-t630/pd http://www.dell.com/us/business/p/poweredge-t630/pd (That last one should be able to hold 4 GPUs but I'm not quite sure about whether or not it will be able to power all of them, Dell isn't helping with their documentation either.) Edit: just found this: http://www.supermicro.nl/products/system/4U/4027/SYS-4027GR-TRT.cfm http://www.supermicro.nl/products/system/4U/4027/SYS-4027GR-... About $4K, + 8 GPUs that's a pretty penny. Drool.
- agravier 9y ago
  I'm using Asus' z10pe-d8 ws with two Xeons. It's got 80 lanes and works all right with 4 GPUS.
  - jacquesm 9y ago
    Neat! What kind of PSU are you running that off and what kind of GPUs?
    - clickok 9y ago
      I have a similar setup to grandparent (Z10PE-D16 WS), running four last-gen TitanX GPUs with an EVGA SuperNOVA P2 1600W PSU. I was a little worried because this is the most power-hungry machine I've ever built, but so far I haven't had any issues. But I'm not going out of my way to start an electrical fire, either. The motherboard in question is pretty deluxe, the only thing I'd complain about is the boot time.
    - agravier 9y ago
      GPUs are GTX Titan (the older 6 GiB cards, not the Titan X), and currently I only use 3 of those with an EVGA SuperNOVA 1300 G2. Full config: Z10PE-D8 WS mobo, 2 x Xeon E5-2620 v4 (32 threads), 128 GiB DDR4 ECC RAM (8*16 GiB), 256 GiB SM961 NVMe, 12 TiB SATA (4 x 3 TiB HGST server drives), 3 x GTX Titan 6GB, Soldam black knight XR1 casing, 2 x DeepCool Gammax 400 CPU coolers, EVGA SuperNOVA 1300 G2 PSU, 2 x Noctua NF-A9 PWM, 2 x Noctua NF-A14 3000 PWM

Asus X99-E WS is a good starting point. You can put four double wide GPUs on that. Another really nice one is this one: https://www.supermicro.nl/Aplus/system/Tower/4021/AS-4021GA-62R_F.cfm https://www.supermicro.nl/Aplus/system/Tower/4021/AS-4021GA-... (AMD based) https://www.supermicro.nl/products/system/4U/7047/SYS-7047GR-TRF.cfm https://www.supermicro.nl/products/system/4U/7047/SYS-7047GR... (Intel based) http://www.dell.com/us/business/p/poweredge-t630/pd http://www.dell.com/us/business/p/poweredge-t630/pd (That last one should be able to hold 4 GPUs but I'm not quite sure about whether or not it will be able to power all of them, Dell isn't helping with their documentation either.) Edit: just found this: http://www.supermicro.nl/products/system/4U/4027/SYS-4027GR-TRT.cfm http://www.supermicro.nl/products/system/4U/4027/SYS-4027GR-... About $4K, + 8 GPUs that's a pretty penny. Drool.

agravier 9y ago
I'm using Asus' z10pe-d8 ws with two Xeons. It's got 80 lanes and works all right with 4 GPUS.
- jacquesm 9y ago
  Neat! What kind of PSU are you running that off and what kind of GPUs?
  - clickok 9y ago
    I have a similar setup to grandparent (Z10PE-D16 WS), running four last-gen TitanX GPUs with an EVGA SuperNOVA P2 1600W PSU. I was a little worried because this is the most power-hungry machine I've ever built, but so far I haven't had any issues. But I'm not going out of my way to start an electrical fire, either. The motherboard in question is pretty deluxe, the only thing I'd complain about is the boot time.
  - agravier 9y ago
    GPUs are GTX Titan (the older 6 GiB cards, not the Titan X), and currently I only use 3 of those with an EVGA SuperNOVA 1300 G2. Full config: Z10PE-D8 WS mobo, 2 x Xeon E5-2620 v4 (32 threads), 128 GiB DDR4 ECC RAM (8*16 GiB), 256 GiB SM961 NVMe, 12 TiB SATA (4 x 3 TiB HGST server drives), 3 x GTX Titan 6GB, Soldam black knight XR1 casing, 2 x DeepCool Gammax 400 CPU coolers, EVGA SuperNOVA 1300 G2 PSU, 2 x Noctua NF-A9 PWM, 2 x Noctua NF-A14 3000 PWM