3 ms·
> I do a lot of similar stuff in my home network with a lot less equipment. This is also my case. For Internet access, I use a router which has 4 2.5 GbE ports
by adrian_b 3y ago
> I do a lot of similar stuff in my home network with a lot less equipment.
This is also my case. For Internet access, I use a router which has 4 2.5 GbE ports for the internal LAN, which was made several years ago with an Intel NUC and 4 USB Ethernet dongles, but which could be done today with a small and cheap fanless router using an "Alder Lake N" Intel N100 or N200 CPU. There are also such small routers with more 2.5 GbE ports for the internal LAN, e.g. 6 or 8. That router implements a lot of network services, including DNS servers for my domain and my own e-mail server.
I also have 5 servers that are interconnected by a 10 GbE subnetwork, but that is done without external switches. Each server has a dual-port 10 Gb/s NIC and they are interconnected directly, in a ring. The servers are normally powered off. Whenever needed, I power on the first of them through Wake-on-Ethernet. Through it, I can power on, also using Wake-on-Ethernet, as many of the others as needed.
- Karrot_Kream 3y agoHuh the ring topology is a really cool idea. With the right routing rules it could open up some ports on my trunk switch, though I'd need to upgrade my NICs. Great idea for whenever I decide to retire the SBC though!
- adrian_b 3y agoWhen all the servers of the ring are powered on, the packets are distributed on both links, so the throughput of the network doubles. When a part of the servers are powered off, the topology of the subnetwork becomes linear and the throughput becomes limited to 10 Gb/s, but with less active servers the traffic is also less. Greater performance can be obtained by using two Ethernet cards with dual 10 Gb/s ports in each computer. With 4 ports per computer total interconnection can be achieved up to 5 nodes and above that each node can be connected to two intersecting rings, which is a topology very frequently used in HPC. An alternative is to use a single card with dual 25 Gb/s ports, per computer. Such cards are not much more expensive than the 10 Gb/s NICs, but the 25 Gb/s switches are very expensive, so a ring topology without switches is even more attractive.