4 ms·

> Unless you buy something like this That is exactly the motherboard that I was thinking of - I just rounded down a little too aggressively (iirc you can get t

by nikcub 10y ago

> Unless you buy something like this That is exactly the motherboard that I was thinking of - I just rounded down a little too aggressively (iirc you can get them for $69 on NewEgg). > not sure about the 1070 but the 980 (non-ti) and the Titan X do not want to work with any PCIe slot I'd completely forgotten about this - thanks. When I initially started setting out a new rig build I was looking at the 970 which would work. Here is pcpartpicker filtered with at least 4x PCIex16: http://pcpartpicker.com/products/motherboard/#h=4,7&sort=a8 http://pcpartpicker.com/products/motherboard/#h=4,7&sort=a8 It brings this board up: http://pcpartpicker.com/product/3YH48d/gigabyte-motherboard-ga990fxaud3r5 http://pcpartpicker.com/product/3YH48d/gigabyte-motherboard-... Think that works? With your cracking setup I can definitely see the attraction of building multiple cheaper boxes rather than one larger one. This is definitely something I need to spend more time researching (which i'd intended) I'm using AWS at the moment - I fire up spot instances but have noticed that there has been a lot of demand recently and prices spike a lot. I've written some basic scripts to bring instances back up, continue tasks, send jobs, shutdown on complete, etc. I'm spending a lot on AWS at the moment which is why i'm looking at putting a new rig together (my old rig broke down a year ago and is 6+ years old)

dogma1138 10y ago
I don't know if the 970 will work, don't have one, IIRC the GTX770 doesn't want to work either, but I don't remember if i tested the 770/780ti's i had lying around from older gaming rigs. The AM3+ mobo's might works, just make sure to get one that actually has been rated for 4-way xfire since I've noticed that quite a few of the mid range ones(regardless of being Intel or AMD) don't actually support more than 2 PCIEx16 power ones at the same time (none of them come with 48 PCIE lanes to begin with). According to wikipedia: 990FX Four physical PCIe 2.0 ×16 slots @ x8 electrical which can be combined to create two PCIe 2.0×16 slots @ x16 electrical, one PCIe 2.0×4 slot and two PCIe 2.0×1 slots, the chipset provides a total of 38 PCIe 2.0 lanes and 4 PCIe 2.0 for A-Link Express III solely in the Northbridge Looks like you'll be getting either 2 x16 electrical with the rest disabled when a card is inserted (if the OEM decided to invest in some extra hardware) or and 4x8 electrical. x8 electrical is usually enough for (most) Nvidia cards to work, not sure about the 1070/1080, but you probably want to confirm it. You can ignore the PCIe land bandwidth since it's not a factor for (most) compute applications, but the electrical stuff is sadly a pitfall, this gen could even be potentially worse since allot of the OEM's dropped to a single power connector (6pin on 1070, and 6/8pin on 1080 non OC cards) which might indicate they are planning to draw more power from the PCIe bus. The fact that Nvidia kinda also dropped support for 3 and 4 way SLI (which now requires an "enthusiast" code that is written to the bios of your card) could also introduce some issues if OEM's pretty much bet that you'll only plug the card into an X16 electrical slot even in SLI so the cards might either not work or not be stable if they are connected to an X8 one (x1/x4 shouldn't work at all unless nvidia did a complete 1080 from the previous gen). P.S. if you are building everything from the ground up and not using old hardware that you already own I would look at old (like 2nd gen Core based Xeon, or old Opteron) servers with lots of PCie slots, you can usually find them for a couple 100's $ on ebay.
- nikcub 10y ago
  Thanks again - i've been digging into the specs of those boards and it does look like you have to go pretty far down that list to get to a board that can support 4x PCI-E v3 x16 simultaneously so you were right with your first comment that it is $250+ HP DL380's which can take 2 cards for $200 - pretty good.

by nikcub 10y ago

dogma1138 10y ago

I don't know if the 970 will work, don't have one, IIRC the GTX770 doesn't want to work either, but I don't remember if i tested the 770/780ti's i had lying around from older gaming rigs. The AM3+ mobo's might works, just make sure to get one that actually has been rated for 4-way xfire since I've noticed that quite a few of the mid range ones(regardless of being Intel or AMD) don't actually support more than 2 PCIEx16 power ones at the same time (none of them come with 48 PCIE lanes to begin with). According to wikipedia: 990FX Four physical PCIe 2.0 ×16 slots @ x8 electrical which can be combined to create two PCIe 2.0×16 slots @ x16 electrical, one PCIe 2.0×4 slot and two PCIe 2.0×1 slots, the chipset provides a total of 38 PCIe 2.0 lanes and 4 PCIe 2.0 for A-Link Express III solely in the Northbridge Looks like you'll be getting either 2 x16 electrical with the rest disabled when a card is inserted (if the OEM decided to invest in some extra hardware) or and 4x8 electrical. x8 electrical is usually enough for (most) Nvidia cards to work, not sure about the 1070/1080, but you probably want to confirm it. You can ignore the PCIe land bandwidth since it's not a factor for (most) compute applications, but the electrical stuff is sadly a pitfall, this gen could even be potentially worse since allot of the OEM's dropped to a single power connector (6pin on 1070, and 6/8pin on 1080 non OC cards) which might indicate they are planning to draw more power from the PCIe bus. The fact that Nvidia kinda also dropped support for 3 and 4 way SLI (which now requires an "enthusiast" code that is written to the bios of your card) could also introduce some issues if OEM's pretty much bet that you'll only plug the card into an X16 electrical slot even in SLI so the cards might either not work or not be stable if they are connected to an X8 one (x1/x4 shouldn't work at all unless nvidia did a complete 1080 from the previous gen). P.S. if you are building everything from the ground up and not using old hardware that you already own I would look at old (like 2nd gen Core based Xeon, or old Opteron) servers with lots of PCie slots, you can usually find them for a couple 100's $ on ebay.

nikcub 10y ago
Thanks again - i've been digging into the specs of those boards and it does look like you have to go pretty far down that list to get to a board that can support 4x PCI-E v3 x16 simultaneously so you were right with your first comment that it is $250+ HP DL380's which can take 2 cards for $200 - pretty good.