4 ms·
Dual-port 100GbE PCI-E 4.0 network cards are now under $1300
- NonEUCitizen 6y agoWhere does it mention price?
- walrus01 6y agoThe spec page there doesn't, google "broadcom p2100g" and you'll see vendor prices... I didn't want to link directly to a vendor for a top level post. https://www.mouser.com/ProductDetail/Broadcom-Avago/BCM957508-P2100G/?qs=T94vaHKWudQeqpHtAKrgqA%3D%3D https://www.mouser.com/ProductDetail/Broadcom-Avago/BCM95750...
- willxinc 6y agoOh wow, didn't know you could buy these of mouser.
- jacquesm 6y agoGah that hurts. Not that it concerns HN, but I immediately thought 'oh, that's neat I have to mail that to friend x', and then while composing the mail in my head I halfway through realized he's been dead for a year. :(
- rovr138 6y agoHey, sorry about that. Good to take some time to remember them sometimes.
- jnwatson 6y agoSay I had two of these cards. How would I send 200Gib of traffic through it? What would the test program look like?
- profquail 6y agoYou could use something based on DPDK, like pktgen-dpdk: https://git.dpdk.org/apps/pktgen-dpdk/ https://git.dpdk.org/apps/pktgen-dpdk/
- bonyt 6y agoFor testing, something like iperf? https://iperf.fr/ https://iperf.fr/ https://community.mellanox.com/s/article/howto-install-iperf-and-test-mellanox-adapters-performance https://community.mellanox.com/s/article/howto-install-iperf...
- CyberDildonics 6y agoAre we advertising for broadcom now?
- qwerty456127 6y agoYou can hardly really advertise it. Nobody invests in 100 GbE NICs taking advertisements seriously rather than knowing some reasons to choose/avoid particular brands/models.
- tomnipotent 6y agoMellanox ConnectX-4 EN has been ~$1000 for awhile now. I'll pick Mellanox over Broadcom every time (even if they're owned by NVIDIA now). https://serversupply.com/NETWORKING/NETWORK%20ADAPTER/100%20GIGABIT/MELLANOX/MCX416A-CCAT_261054.htm https://serversupply.com/NETWORKING/NETWORK%20ADAPTER/100%20...
- walrus01 6y agoExcept that's pci-e 3.0 unlike the cards from broadcom and intel.
- caskstrength 6y agoOn the same website you can also find pci-e 4.0 Connectx-5 for slightly more than 1k$ though.
- deleted 6y ago[deleted]
- tomnipotent 6y agoPCIe 3.0 x16 is capable of 36GB/s. A single 100G NIC is only 12.5GB/s.
- walrus01 6y agoYes, if it's a one way traffic flow, but a 100GbE link as used in a router is full duplex. If looking at a traffic chart, you could have 75-80Gbps of traffic inbound and also 70-80Gbps of traffic outbound simultaneously. Using a smaller traffic example, on a much older Juniper router that has linecards with 20Gbps full duplex to the backplane, each line card can hold two 10GbE PICs without oversubscription. If you want to have a line-rate-capable 100GbE x86-64 whitebox router using FRR or similar, you want to budget PCI-E bus bandwidth for a maximum of approximately 24GB/s per dual port 100GbE NIC.
- bombcar 6y agoMore importantly, 10GbE cards are cheap as free on eBay. That + a Mikrotik CRS305-1G-4S+IN and some direct connect cables you can have a 10GbE network in your house for well under $300.
- pyro2927 6y agoThat's what I just did! Been loving it!
- koolba 6y agoCan I run this on vanilla Cat5e or do I have to put in Cat6?
- ianlevesque 6y agoCat5e usually works fine. For longer distances you will need the correct (cat6 or better) though.
- wtallis 6y agoThe cheap used 10Gb NICs and the switch mentioned use SFP+ ports rather than RJ45. 10GBASE-T SFP+ modules are expensive and power-hungry compared to direct-attach twinax cables or fiber + transceivers.
- bombcar 6y agoI had a flat CAT 6 cable and could only get 5GbE - upgraded to a normal cat 7 cable and got the 10GbE.
- Teknoman117 6y agoI picked up the 8 port version from Microtik and picked up a Mellanox ConnectX-2 of eBay which came with a pair of 10G SFP+ fiber modules. A 10 meter single mode LC fiber off Amazon was like $20. As for the NAS, I snagged a Supermicro mini-ITX 8-core Xeon D (Broadwell era) board from eBay as well for like $400. It brings out the dual integrated 10G NICs on the Xeon D, a PCIe 3.0 x16 port, a 4 lane M.2 port, and 6x SATA ports, 4 slots for DDR4 ECC RDIMMs, and an ASPEED based IPMI. Adding 64 GiB of RDIMMs, 6x 10 TB WD drives, and 2x M.2 drives on a bifurcating riser made for a killer NAS and VM host (crammed inside a Fractal Node 304)
- bhouston 6y agoThere are no Internet providers in Canada that do more than 1.5Gbps though (Ball Canada claims to have 1.5Gbps down) and even that is mostly just claimed and rarely delivered. These days my compute workloads are mostly in the cloud and all my files are there as well. Thus local speeds do not matter much if the Internet can not also feed them. I guess this matters for data centres, but primarily my data centres are run by AWS and GCP, so I do not buy this hardware myself.
- hackcasual 6y agoWould be really cool to have all my local systems have little local disk, but instead share a NAS. But still a very niche use case
- 1ncorrect 6y agoNot being the bottleneck doesn’t make increased throughput completely superfluous. The faster you can communicate across a channel, the quicker you can shut up and get to idle, saving power on both transmission and policing of resource contention. You also have more time to handle locally scoped retries and error correction.
- 908B64B197 6y agoGoogle Fiber can do 2Gbps.
- wmf 6y agoSpeaking of Canada, Linus "Tech Tips" Sebastian mentioned this very argument in a recent video where he was installing 100G and 25G in his office for workgroup video editing. Not everything is in the cloud yet.
- GekkePrutser 6y agoI'd really love it if the 10GbE cards would drop under $13 :) And especially the switches to become cheap. It really feels like we've had 1GbE like forever (it was already standard on my 2004 PowerBook!!). But 10GbE is still hardly affordable.
- musicale 6y agoExactly this. Few laptops have 10GbE, though many have Thunderbolt and USB 3.1.
- mjevans 6y agoI hope all the patents expire soon and that good products at good prices follow quickly. The standard was released in 2006, but I'm not sure how close to that release date the last relevant patent involved was issued. https://en.wikipedia.org/wiki/10_Gigabit_Ethernet#10GBASE-T https://en.wikipedia.org/wiki/10_Gigabit_Ethernet#10GBASE-T "10GBASE-T, or IEEE 802.3an-2006, is a standard released in 2006 to provide 10 Gbit/s connections over unshielded or shielded twisted pair cables, over distances up to 100 metres (330 ft)."
- willis936 6y agoWhat is pantented about implementations? I’m surprised that the nature of the implementation of a public specification is patentable. I spent a few years implementing 802.3 physical layer testing. At the conferences it was clear that things were written carefully to not cover implementation, but they went so far in the necessary details that there were only a handful of reasonably performant and economical solutions.
- msbarnett 6y ago> I’m surprised that the nature of the implementation of a public specification is patentable. Prepare to be very surprised, I guess? It’s pretty routinely done, eg) look at any of the MPEG standards. I don’t know what patents, if any, cover 10GigE, but in general IEEE, which governs that standard, will accept Essential Patent Claims in a standard provided the Patent Holder will provide a Letter of Assurance indicating that they will license said patents under FRAND (fair, reasonable, and non-discriminatory) terms – which does not mean free.
- continuations 6y agoAre there any dedicated server hosters that give you 100Gbps private networking among your servers?
- wmf 6y agoAWS has 100G in some instance types.
- wmf 6y agoIntel https://www.colfaxdirect.com/store/pc/viewPrd.asp?idproduct=3929&idcategory= https://www.colfaxdirect.com/store/pc/viewPrd.asp?idproduct=... and Mellanox https://www.colfaxdirect.com/store/pc/viewPrd.asp?idproduct=3668&idcategory= https://www.colfaxdirect.com/store/pc/viewPrd.asp?idproduct=... are around $800, and a single-port card is under $700.
- musicale 6y agoMy laptop has four 40 Gb/s ports on it. None of them are Ethernet.
- haydn3 6y agoEthernet has wide adoption and standards tested for years. It's going to be hard to knock it for a different solution anytime soon. But we'll see :)
- akvadrako 6y agoAnd much shorter range. Passive thunderbolt is only about a meter, active is longer but nothing like 100m.
- wmf 6y agoTo be fair, 100G twinax is only 5m. Both Ethernet and Thunderbolt need fiber to go 100m.