4 ms·

I just wish they had 2x5GbE like the Orion O6. i/o heavily matters for my compute nodes. I wonder if 802.3ad bonding can bring 5gbit/s

modeless 5mo ago
Seems like you could add that pretty easily via USB and/or M.2. Either should have the necessary bandwidth.
- preisschild 5mo ago
  I would use the m.2 e keys for sata and x4 m key for nvme ssds. That only leaves pcie gen3 x2. I want to run a distributed network storage (ceph)
adrian_b 5mo ago
It says that it has four 10 Gb/s USB ports (2 Type A and 2 Type C). It is unknown whether the ports are independent, or some of them or all of them are connected to an internal hub. Even if they were connected to a single CPU port through an internal hub, if you used two 5 Gb/s USB Ethernet interfaces you would get close to full speed for them. Having 10 Gb/s USB instead of the so-called "5 Gb/s" USB (in reality 4 Gb/s), provides much more additional I/O throughput than having 5 Gb/s RJ45 instead of 2.5 Gb/s. I agree that having 5 Gb/s Ethernet would have been nice, but it is much more valuable that it has 10 Gb/s USB, which is very rarely encountered on Arm-based computers.
- HeyMeco 5mo ago
  They’re independent
- preisschild 5mo ago
  I wonder how well a usb 10gbit ethernet adapter would work then But I really apprecate your reply! I'll definitely buy one for testing when they become available for reasonable prices <500EUR for 16gig memory
  - volemo 5mo ago
    Hmm, is it possible to skip the Ethernet adapters in a configuration of USBC-Eth-Eth-USBC and connect USBCs directly one to another?
    - adrian_b 5mo ago
      Unfortunately, USB does not work like Firewire, where this was possible. USB 4, i.e. Thunderbolt, allows the emulation of network interfaces if you interconnect the USB Type C ports with a cable, but here you have USB 3, so this does not work. On USB 3 you could interconnect 2 ports only if one of them implemented the On-the-Go specification, so it could work as either a peripheral port or a host port. Here this also does not work. On a system where this had been allowed by the hardware, it is likely that you would have needed to write yourself a device driver that emulates a network interface, because I am not aware of an already existing one, unlike for USB 4.
      - zokier 5mo ago
        > USB 4, i.e. Thunderbolt USB4 and TB are different things (confusingly enough)
        adrian_b 5mo ago
        USB 4 includes more than Thunderbolt, because Thunderbolt was not compatible with USB, despite using the same connector. All features of Thunderbolt 3 have been inherited by USB 4, like also all those of USB 3, including the ability of Thunderbolt to emulate Ethernet interfaces when you interconnect 2 computers with a cable through their USB 4 ports, like it was already possible with Thunderbolt ports.
      - volemo 5mo ago
        How could I forget about the staggering complexity of USB versions! Of course the answer is “maybe”.
  - adrian_b 5mo ago

modeless 5mo ago

Seems like you could add that pretty easily via USB and/or M.2. Either should have the necessary bandwidth.

preisschild 5mo ago
I would use the m.2 e keys for sata and x4 m key for nvme ssds. That only leaves pcie gen3 x2. I want to run a distributed network storage (ceph)

adrian_b 5mo ago

It says that it has four 10 Gb/s USB ports (2 Type A and 2 Type C). It is unknown whether the ports are independent, or some of them or all of them are connected to an internal hub. Even if they were connected to a single CPU port through an internal hub, if you used two 5 Gb/s USB Ethernet interfaces you would get close to full speed for them. Having 10 Gb/s USB instead of the so-called "5 Gb/s" USB (in reality 4 Gb/s), provides much more additional I/O throughput than having 5 Gb/s RJ45 instead of 2.5 Gb/s. I agree that having 5 Gb/s Ethernet would have been nice, but it is much more valuable that it has 10 Gb/s USB, which is very rarely encountered on Arm-based computers.

HeyMeco 5mo ago
They’re independent
preisschild 5mo ago
I wonder how well a usb 10gbit ethernet adapter would work then But I really apprecate your reply! I'll definitely buy one for testing when they become available for reasonable prices <500EUR for 16gig memory
- volemo 5mo ago
  Hmm, is it possible to skip the Ethernet adapters in a configuration of USBC-Eth-Eth-USBC and connect USBCs directly one to another?
  - adrian_b 5mo ago
    Unfortunately, USB does not work like Firewire, where this was possible. USB 4, i.e. Thunderbolt, allows the emulation of network interfaces if you interconnect the USB Type C ports with a cable, but here you have USB 3, so this does not work. On USB 3 you could interconnect 2 ports only if one of them implemented the On-the-Go specification, so it could work as either a peripheral port or a host port. Here this also does not work. On a system where this had been allowed by the hardware, it is likely that you would have needed to write yourself a device driver that emulates a network interface, because I am not aware of an already existing one, unlike for USB 4.
    - zokier 5mo ago
      > USB 4, i.e. Thunderbolt USB4 and TB are different things (confusingly enough)
      - adrian_b 5mo ago
        USB 4 includes more than Thunderbolt, because Thunderbolt was not compatible with USB, despite using the same connector. All features of Thunderbolt 3 have been inherited by USB 4, like also all those of USB 3, including the ability of Thunderbolt to emulate Ethernet interfaces when you interconnect 2 computers with a cable through their USB 4 ports, like it was already possible with Thunderbolt ports.
    - volemo 5mo ago
      How could I forget about the staggering complexity of USB versions! Of course the answer is “maybe”.
- adrian_b 5mo ago