3 ms·

> In their infinite wisdom, ethernet decided there was no need for speeds between 1GbE and 10GbE. They finally caved to reality with 40GbE, 25GbE, and 50GbE. I

> In their infinite wisdom, ethernet decided there was no need for speeds between 1GbE and 10GbE. They finally caved to reality with 40GbE, 25GbE, and 50GbE. I’m not sure that’s accurate. There were no intermediate steps to get to 10GbE, it was a straight jump from 1GbE and it was relatively easy. To get to 40GbE, it involved running four lanes of 10GbE. To get to 100GbE, it involved running four lanes of 25GbE. 50GbE is just two lanes of 25GbE. We’ve gone from a single serialised stream to multiple parallel streams in order to reach next order speeds. This is magnified when you start looking at 400GbE and 800GbE services that operate on 8 lanes (QSFP-DD or the confusingly named OSFP).

jdnenej 7y ago
10gbit networking gear is massively more expensive than 1gbit
- amiga-workbench 7y ago
  Its finally beginning to fall in price, Microtik are doing relatively inexpensive routers with 10gig SFP ports.
  - gitgudnubs 7y ago
    If I were going to sell a network attached spinning disk at scale, then I would probably target 2.5GBASE-T. The problem there is that no routers support it.
gitgudnubs 7y ago
>it was a straight jump from 1GbE and it was relatively easy. It wasn't relatively easy, because you can't run 10GBASE-T over Cat5e, and because a 10GbE NIC was as expensive as the rest of the drive put together. Today you can run 2.5GBASE-T over Cat5e, but the standard was too late, and there was very little demand between 1GbE and 10GbE, so there are virtually no controllers. What controllers you can find are usually 10GbE controllers that can also do 2.5GbE. Until 2Gbps home internet and LANs become popular, there's no reason to expect change. >There were no intermediate steps to get to 10GbE That's the problem. Disk transfer rates can approach 1.5Gbps, so a 1GbE is a serious bottleneck. But 10 GbE hardware was significantly more expensive. What am I going to do, build a JBOD with a dozen disks and 1x10GbE, or put a dozen disks onto the network with 10GbE interfaces? So instead you need 2x1GbE on every disk, which complicates management and doubles cabling, switches, and cost. >We’ve gone from a single serialised stream to multiple parallel streams in order to reach next order speeds. Which is hilarious when you consider PATA.

jdnenej 7y ago

10gbit networking gear is massively more expensive than 1gbit

amiga-workbench 7y ago
Its finally beginning to fall in price, Microtik are doing relatively inexpensive routers with 10gig SFP ports.
- gitgudnubs 7y ago
  If I were going to sell a network attached spinning disk at scale, then I would probably target 2.5GBASE-T. The problem there is that no routers support it.

gitgudnubs 7y ago

>it was a straight jump from 1GbE and it was relatively easy. It wasn't relatively easy, because you can't run 10GBASE-T over Cat5e, and because a 10GbE NIC was as expensive as the rest of the drive put together. Today you can run 2.5GBASE-T over Cat5e, but the standard was too late, and there was very little demand between 1GbE and 10GbE, so there are virtually no controllers. What controllers you can find are usually 10GbE controllers that can also do 2.5GbE. Until 2Gbps home internet and LANs become popular, there's no reason to expect change. >There were no intermediate steps to get to 10GbE That's the problem. Disk transfer rates can approach 1.5Gbps, so a 1GbE is a serious bottleneck. But 10 GbE hardware was significantly more expensive. What am I going to do, build a JBOD with a dozen disks and 1x10GbE, or put a dozen disks onto the network with 10GbE interfaces? So instead you need 2x1GbE on every disk, which complicates management and doubles cabling, switches, and cost. >We’ve gone from a single serialised stream to multiple parallel streams in order to reach next order speeds. Which is hilarious when you consider PATA.