4 ms·

> make a real router of an x86-64 system rather than putting a mikrotik pci-e card into it (wtf, why?) I'd recommend they go with vyatta or VyOS instead One th

> make a real router of an x86-64 system rather than putting a mikrotik pci-e card into it (wtf, why?) I'd recommend they go with vyatta or VyOS instead One thing I've been looking for is a hardware box that can replicate what Ubiquiti's EdgeRouter Infinity does: a handful of 10Gbps SFP+ ports (sorry, I know that the term is "cages" but I just can't) and a couple of copper 1Gbps ports. So far I haven't found anything but I feel like my search will get motivated in the next couple of years since it feels like Ubiquiti has forgotten that EdgeRouter exists. Do you have any rack form factor x86-type systems you like for VyOS?

walrus01 5y ago
When space permits I prefer full-size 1U systems that have dual/hotswap power supplies and room for three low profile pci-e slots, such as a Dell R630/R640 or similar. With Intel chipset 4-port 10GbE SFP+ NICs this would max out at twelve ports plus whatever is on the motherboard daughtercard for network interfaces (2 x 10GbE + 2 x 1GbE copper, or whatever). for smaller or shallow stuff, supermicro, msi, tyan, asus
logifail 5y ago
> a hardware box [with] a handful of 10Gbps SFP+ [..] and a couple of copper 1Gbps ports I have a couple of (fanless!) CRS305-1G-4S+IN[0] at home, one in my study and one in the utility room. They each connect with 10GbE fibre (or DAC) to ConnectX-3 cards in my PCs and servers. [0] https://mikrotik.com/product/crs305_1g_4s_in https://mikrotik.com/product/crs305_1g_4s_in
- techsupporter 5y ago
  I appreciate the recommendation but that's kind of a gap from the EdgeRouter Infinity (ER-8-XG). The Infinity has 8x10Gbps SFP+ ports, a single copper 1Gbps port, 16GB of RAM, and a multi-core processor because it's designed as an inexpensive core router for a mid-sized network. Where I work, we use one of them as our main router with multiple peering sessions and two transit uplinks. According to Cacti, right now we're pushing about 30Gbps through the router. That's what I'm looking to eventually replace, if Ubiquiti doesn't start up with software updates to the EdgeRouter line again. But I think that's the problem: the EdgeRouter line is so amazingly inexpensive for all of the power you get, there's no financial incentive for Ubiquiti to invest in it and all of the players with the "proper" routers--the Junipers and Ciscos and the like--start at three times the price of an ER-8-XG.
  - logifail 5y ago
    > that's kind of a gap from the EdgeRouter Infinity (ER-8-XG) Indeed, not least on price. How much was your ER-8-XG? My CRS305-1G-4S+IN were about USD180 each. EDIT: If there were a silent version of the CRS326-24S+2Q+RM[0][1] I'd have bought one already... "The MikroTik CRS326-24S+2Q+RM is an insane switch. Its specs are relatively mundane by modern standards. It has 24x SFP+ 10GbE ports and 2x QSFP+ 40GbE ports making it not even as powerful as mainstream previous-generation switches like the QCT QuantaMesh T3048-LY8 that we installed in our lab years ago. Instead what makes the switch insane is that it offers all of that performance at $475" [0] https://mikrotik.com/product/crs326_24s_2q_rm https://mikrotik.com/product/crs326_24s_2q_rm [1] https://www.servethehome.com/mikrotik-crs326-24s2qrm-review-insane-switch/ https://www.servethehome.com/mikrotik-crs326-24s2qrm-review-...
    - Alupis 5y ago
      For what it's worth - there is a healthy "modding" community for some of these Mikrotik switches. People convert them into fanless/silent units pretty regularly, or swap the fans for higher flow / lower rpm fans, etc.
    - walrus01 5y ago
      a crs326 is a layer 2 switch - not comparable with a router. you could categorize it as more like a cisco 3750G from ten years ago in capability of 24 ports of copper gigabit in one place. any mikrotik CRS series has very limited routing/layer 3 ability compared to a CCR series. Different things for different purposes. look at the logical block diagrams mikrotik provides of their crs series equipment. it's all a bunch of ethernet switch chips in a few blocks of 8 ports and then something like a single 1GbE link to the CPU. the moment you start telling it to do layer 3 things its capability is very limited. https://i.mt.lv/cdn/product_files/CRS326_180248.png https://i.mt.lv/cdn/product_files/CRS326_180248.png
  - vetinari 5y ago
    Have look at Mikrotik CCR2004-1G-12S+2XS (1G-12S+2XS means 1x1Gbps RJ45, 12xSFP+, 2xSFP28) or CCR2116-12G-4S+ (12G-4S+ = 12x1Gbps RJ45, 4xSFP+), depending how many ports and what kind of routing performance you need (check the block diagrams, they tell the story). However, neither of them will route 80 Gbps full duplex. Then there is CCR2216-1G-12XS-2XQ (1x1Gbps, 12xSFP28, 2xQSPF28); this one is supposedly capable of routing shy of 200 Gbps @1518 packet size. Edit: another thing on Mikrotik naming conventions: CRS = switches; CCR = routers.

walrus01 5y ago

When space permits I prefer full-size 1U systems that have dual/hotswap power supplies and room for three low profile pci-e slots, such as a Dell R630/R640 or similar. With Intel chipset 4-port 10GbE SFP+ NICs this would max out at twelve ports plus whatever is on the motherboard daughtercard for network interfaces (2 x 10GbE + 2 x 1GbE copper, or whatever). for smaller or shallow stuff, supermicro, msi, tyan, asus

logifail 5y ago

> a hardware box [with] a handful of 10Gbps SFP+ [..] and a couple of copper 1Gbps ports I have a couple of (fanless!) CRS305-1G-4S+IN[0] at home, one in my study and one in the utility room. They each connect with 10GbE fibre (or DAC) to ConnectX-3 cards in my PCs and servers. [0] https://mikrotik.com/product/crs305_1g_4s_in https://mikrotik.com/product/crs305_1g_4s_in

techsupporter 5y ago
I appreciate the recommendation but that's kind of a gap from the EdgeRouter Infinity (ER-8-XG). The Infinity has 8x10Gbps SFP+ ports, a single copper 1Gbps port, 16GB of RAM, and a multi-core processor because it's designed as an inexpensive core router for a mid-sized network. Where I work, we use one of them as our main router with multiple peering sessions and two transit uplinks. According to Cacti, right now we're pushing about 30Gbps through the router. That's what I'm looking to eventually replace, if Ubiquiti doesn't start up with software updates to the EdgeRouter line again. But I think that's the problem: the EdgeRouter line is so amazingly inexpensive for all of the power you get, there's no financial incentive for Ubiquiti to invest in it and all of the players with the "proper" routers--the Junipers and Ciscos and the like--start at three times the price of an ER-8-XG.
- logifail 5y ago
  > that's kind of a gap from the EdgeRouter Infinity (ER-8-XG) Indeed, not least on price. How much was your ER-8-XG? My CRS305-1G-4S+IN were about USD180 each. EDIT: If there were a silent version of the CRS326-24S+2Q+RM[0][1] I'd have bought one already... "The MikroTik CRS326-24S+2Q+RM is an insane switch. Its specs are relatively mundane by modern standards. It has 24x SFP+ 10GbE ports and 2x QSFP+ 40GbE ports making it not even as powerful as mainstream previous-generation switches like the QCT QuantaMesh T3048-LY8 that we installed in our lab years ago. Instead what makes the switch insane is that it offers all of that performance at $475" [0] https://mikrotik.com/product/crs326_24s_2q_rm https://mikrotik.com/product/crs326_24s_2q_rm [1] https://www.servethehome.com/mikrotik-crs326-24s2qrm-review-insane-switch/ https://www.servethehome.com/mikrotik-crs326-24s2qrm-review-...
  - Alupis 5y ago
    For what it's worth - there is a healthy "modding" community for some of these Mikrotik switches. People convert them into fanless/silent units pretty regularly, or swap the fans for higher flow / lower rpm fans, etc.
  - walrus01 5y ago
    a crs326 is a layer 2 switch - not comparable with a router. you could categorize it as more like a cisco 3750G from ten years ago in capability of 24 ports of copper gigabit in one place. any mikrotik CRS series has very limited routing/layer 3 ability compared to a CCR series. Different things for different purposes. look at the logical block diagrams mikrotik provides of their crs series equipment. it's all a bunch of ethernet switch chips in a few blocks of 8 ports and then something like a single 1GbE link to the CPU. the moment you start telling it to do layer 3 things its capability is very limited. https://i.mt.lv/cdn/product_files/CRS326_180248.png https://i.mt.lv/cdn/product_files/CRS326_180248.png
- vetinari 5y ago
  Have look at Mikrotik CCR2004-1G-12S+2XS (1G-12S+2XS means 1x1Gbps RJ45, 12xSFP+, 2xSFP28) or CCR2116-12G-4S+ (12G-4S+ = 12x1Gbps RJ45, 4xSFP+), depending how many ports and what kind of routing performance you need (check the block diagrams, they tell the story). However, neither of them will route 80 Gbps full duplex. Then there is CCR2216-1G-12XS-2XQ (1x1Gbps, 12xSFP28, 2xQSPF28); this one is supposedly capable of routing shy of 200 Gbps @1518 packet size. Edit: another thing on Mikrotik naming conventions: CRS = switches; CCR = routers.