4 ms·
"probably consuming like x100 the power" is greatly exaggerated. A typical PC might have an idle power consumption of less than 50 W, while a very small comput
by adrian_b 5y ago
"probably consuming like x100 the power" is greatly exaggerated.
A typical PC might have an idle power consumption of less than 50 W, while a very small computer with ARM little cores might have an idle power of 2 ... 3 W, so at most the power consumption ratio would be 20.
However even that is not realistic because a computer or appliance with less than 3 W power consumption will not be able to route 10 Gb/s or faster links and it will struggle even with multiple 1 Gb/s ports.
A dedicated router appliance able to route 10 Gb/s or faster links will probably have an idle power of around 10 W or even more.
For routing only 1 Gb/s links, you can use among the standard PC's a NUC-like model, which will have an idle power consumption between 5 W and 10 W, quite close to a dedicated appliance. This is actually what I am using for my own Internet router/firewall (which also runs many other services, e.g. DNS server and proxy, NTP, e-mail, HTTP server and proxy etc.) with 1 external 1 Gb/s port and 4 internal 1 Gb/s ports (4 of the 5 ports are made with USB to Ethernet adapters).
Some of the more recent NUC or similar computers have multiple Thunderbolt ports or 10 Gb/s USB ports, so those can be used to route multiple 10 Gb/s links (using Ethernet adapters), with an idle power of around 10 W, similar to any equivalent commercial routers.
For 25 Gb/s Ethernet links, a commercial router is unlikely to be much cheaper or to consume much less than a standard PC.
- tomnipotent 5y agoSFP requires less energy than RJ45, only 0.7W/port. The MikroTik 4-port CRS305-1G-4S+IN draws 10-18W.
- bcrl 5y agoThat's not entirely true. SFP power consumption depends on the type of SFP. A 10Gbps DWDM SFP+ might draw 1.8W of power. The why for this is actually quite interesting: the lasers used in DWDM SFPs have much more stringent requirements for temperature stability to ensure the light emitted doesn't drift out of spec. In order to achieve that temperature stability, they use a built in peltier to pump heat away from the laser and control the temperature. They're quite the marvel of modern engineering!
- oasisbob 5y agoIt would have been fun to be a fly on the wall at Cisco when they first realized people were jamming devices with heaters in SPF sockets.
- eqvinox 5y agoCisco didn't "realize" this was happening, they specified, had manufactured, and sold the very SFPs the GP post is describing. SFP slots in routers are designed with this thermal load in mind. Which is also why plugging a large amount of DWDM optics into a datacenter switch is a bad idea. Datacenter switches are _not_ designed with this in mind. You run into risks of both overheating the switch as well as overloading the PSUs. A small number of high-power optics ain't gonna break the switch though. And: 10Gbase-T SFPs have horrendous power consumption, even worse than DWDM SFPs. At these speeds, the signal over copper is mostly mush, and the PHY contains a none-too-trivial analog & digital signal processor. Which, again, is where limitations for 10Gbase-T SFP usage come from. If at all possible, avoid this shit — there's absolutely no reason to have 10Gbase-T inside a rack, for example. Just use DAC cables or SR optics.
- oasisbob 5y agoI'm being a bit glib, but from the point of view of someone who used SFP optics once in a while, it seemed like the whole "standard" was a bit of a mess. If it was known that vendors would try to push their thermals past what the device cage would support, why not address that better? The general impression I was given is that thermal loads were one of the primary reasons given for vendor-locking pluggable optics, and that the original SFP spec didn't even address it.
- tomnipotent 5y agoExcept no one is using DWDM for homelabs, as it's usually used for longer distances. The peltier cooler is definitely cool, though.
- bcrl 5y ago
- logifail 5y ago> MikroTik 4-port CRS305-1G-4S+IN I have two of these at home, they're neat little bits of kit. They're fanless and therefore silent, which is fine until you realise you want to do 10GbE over existing copper cables with something like Mikrotik's S+RJ10 adapter. Then the temps start to rise... So, I've decided to go completely to fibre, even if it means opening up the walls of the house. Just bought a job lot of used ConnectX-3 cards off ebay.
- lostlogin 5y ago> ConnectX-3 cards off ebay. Those cards are so good. I got a few after seeing them rated in r/homelab and haven’t looked back. The Synology took one and it was about 1/10th the price the official Synology one was.
- tomnipotent 5y ago> Those cards are so good Agreed. You can find them on eBay for ~$40 a pop, and they work flawlessly on Linux and Windows. I've made a few purchases from the seller "bitsquad" (ships from Kentucky), and he always seems to have Mellanox/Chelsio in stock.
- walterbell 5y agoHow do you obtain custom lengths of fibre cables that work with ConnectX-3?
- tomnipotent 5y agoUse fs.com, their generic cables work with MikroTik no issue and they do custom orders.
- eqvinox 5y agoThe ConnectX-3 cards are not vendor locked in any way. (And even if they were, that'd only affect the SFP, not the cable.)
- secure 5y ago
- goodpoint 5y ago> For 25 Gb/s Ethernet links, a commercial router is unlikely to be much cheaper or to consume much less than a standard PC. EDIT: I linked to a switch by mistake. This router has 12 x 10G SFP+ and 2 x 25G SFP28 ports and costs $595 It appears to be routing between 13 to 39Gbps depending on the rule complexity. https://mikrotik.com/product/ccr2004_1g_12s_2xs#fndtn-specifications https://mikrotik.com/product/ccr2004_1g_12s_2xs#fndtn-specif...
- realityking 5y agoThat‘s a switch, not a router. Much simpler hardware. Here‘s a MikroTik Router with 28 Gbit/a throughput: https://mikrotik.com/product/CCR1036-8G-2SplusEM https://mikrotik.com/product/CCR1036-8G-2SplusEM $1300 and up to 73W
- coder543 5y agoThat's a bit of an odd example to choose. This[0] has a $600 MSRP, with twelve 10Gbps ports and two 25Gbps ports. It's ~32W before you add the SFP+ modules, and upwards of 50W if you have all modules populated. In the benchmarks they list, this can provide somewhere on the order of 13Gbps to 40Gbps of routing, depending on exactly what you're doing. (Smaller packets will lower these numbers, but if you care about bandwidth you're unlikely to be worried about smaller packets... at that point, you probably care more about kpps.) [0]: https://mikrotik.com/product/ccr2004_1g_12s_2xs https://mikrotik.com/product/ccr2004_1g_12s_2xs
- ikiris 5y agothe benchmark you even link shows absolutely abysmal performance curves, dropping down into even half a gig perf for small packets single stream.
- coder543 5y agoCalling any benchmark "abysmal" requires a point of comparison, and you have provided none... so it doesn't really encourage good discussion. What's the point of your comment? It seems to just be a way of insulting someone else's product. Which comparably priced router are you thinking of that has a "non-abysmal" performance curve for small packet bandwidth?