3 ms·

I've been looking at doing this at home with the Mikrotik CRS305-1G-4S+IN. I honestly don't have a need for it right now, but just knowing that it's possible ma

I've been looking at doing this at home with the Mikrotik CRS305-1G-4S+IN. I honestly don't have a need for it right now, but just knowing that it's possible makes me want to go for it...

MrFoof 6y ago
I just started doing a large overhaul (first in 10 years), and moving to 10GbE was a pretty big deal. When your storage is fast, waiting for the network is the real bottleneck. Uploading things on a WAN link (I have 1Gbps down, but only 40-50Mbps up) is the new drag. For video editing I can use the SSDs on the workstation, though I can also saturate the 10GbE connection to an iSCSI target on a Synology full of hard disks in RAID 10. Want to provision a new virtual machine? I have some 1L form factor computers (Some 175x175x35mm HPs with 8-core Ryzen 7 PRO APUs that sip 12-15W at idle) in an XCP-NG cluster. Build an image and provision it quickly. I'm a bit limited here as USB 3 NICs tend to cap out at 3.5Gbps because the top of the controller's block diagram is a 3.2 Gen 1, but when USB Type-C Gen 2 NICs hit they'll rip along at around 7-8Gbps, pulling large built images down from the Synology and writing it to their SSDs (980 Pros) in well under 10 seconds. Scary stuff though is the virtualized Spark cluster running on my workstation. Four Intel D7-P5510s in RAID10. With ~25GB/sec of sequential reads you're not held up by storage anymore. Just the network when you want to write out results, and any suboptimal code to ensure you don't starve the CPU cores because you're not ripping through memory fast enough. The fast new reality is great. Join in. :)
katbyte 6y ago
Switched my core network for 10g last summer with no regrets, can imagine life without it now tbh
- Hamuko 6y ago
  For what cost?
  - moonbug 6y ago
    hardly anything, old mellanox NICs are practically free on eBay, DACs and 10g optics are a pittance. Even DC 10g switching is cheap. Franky, 100ge is within home budgets now.
    - NullPrefix 6y ago
      Dollars, please express your opinions in monetary values.
      - katbyte 6y ago
        i personally spent about 700$ - but i got a fancy managed switch. NICs for were about 200$
  - magicalhippo 6y ago
    I've got some Mellanox cards for about 20-30 USD each, some direct attach cable can be had for a few dollars as well. Later I picked up some cheap optical gear from FS[1] for when I moved my NAS into another room. About $20 for the transceivers and fiber cable was not expensive either. Regular 1GbE is sooo low now. Not got the switch yet, just running point to point. Using a different IP range so I'm sure I'm hitting that 10G goodness. [1]: https://www.fs.com https://www.fs.com

I've been looking at doing this at home with the Mikrotik CRS305-1G-4S+IN. I honestly don't have a need for it right now, but just knowing that it's possible makes me want to go for it...

MrFoof 6y ago

I just started doing a large overhaul (first in 10 years), and moving to 10GbE was a pretty big deal. When your storage is fast, waiting for the network is the real bottleneck. Uploading things on a WAN link (I have 1Gbps down, but only 40-50Mbps up) is the new drag. For video editing I can use the SSDs on the workstation, though I can also saturate the 10GbE connection to an iSCSI target on a Synology full of hard disks in RAID 10. Want to provision a new virtual machine? I have some 1L form factor computers (Some 175x175x35mm HPs with 8-core Ryzen 7 PRO APUs that sip 12-15W at idle) in an XCP-NG cluster. Build an image and provision it quickly. I'm a bit limited here as USB 3 NICs tend to cap out at 3.5Gbps because the top of the controller's block diagram is a 3.2 Gen 1, but when USB Type-C Gen 2 NICs hit they'll rip along at around 7-8Gbps, pulling large built images down from the Synology and writing it to their SSDs (980 Pros) in well under 10 seconds. Scary stuff though is the virtualized Spark cluster running on my workstation. Four Intel D7-P5510s in RAID10. With ~25GB/sec of sequential reads you're not held up by storage anymore. Just the network when you want to write out results, and any suboptimal code to ensure you don't starve the CPU cores because you're not ripping through memory fast enough. The fast new reality is great. Join in. :)

katbyte 6y ago

Switched my core network for 10g last summer with no regrets, can imagine life without it now tbh

Hamuko 6y ago
For what cost?
- moonbug 6y ago
  hardly anything, old mellanox NICs are practically free on eBay, DACs and 10g optics are a pittance. Even DC 10g switching is cheap. Franky, 100ge is within home budgets now.
  - NullPrefix 6y ago
    Dollars, please express your opinions in monetary values.
    - katbyte 6y ago
      i personally spent about 700$ - but i got a fancy managed switch. NICs for were about 200$
- magicalhippo 6y ago
  I've got some Mellanox cards for about 20-30 USD each, some direct attach cable can be had for a few dollars as well. Later I picked up some cheap optical gear from FS[1] for when I moved my NAS into another room. About $20 for the transceivers and fiber cable was not expensive either. Regular 1GbE is sooo low now. Not got the switch yet, just running point to point. Using a different IP range so I'm sure I'm hitting that 10G goodness. [1]: https://www.fs.com https://www.fs.com