9 ms·
I just started doing a large overhaul (first in 10 years), and moving to 10GbE was a pretty big deal. When your storage is fast, waiting for the network is the
by MrFoof 6y ago
I just started doing a large overhaul (first in 10 years), and moving to 10GbE was a pretty big deal. When your storage is fast, waiting for the network is the real bottleneck. Uploading things on a WAN link (I have 1Gbps down, but only 40-50Mbps up) is the new drag.
For video editing I can use the SSDs on the workstation, though I can also saturate the 10GbE connection to an iSCSI target on a Synology full of hard disks in RAID 10.
Want to provision a new virtual machine? I have some 1L form factor computers (Some 175x175x35mm HPs with 8-core Ryzen 7 PRO APUs that sip 12-15W at idle) in an XCP-NG cluster. Build an image and provision it quickly. I'm a bit limited here as USB 3 NICs tend to cap out at 3.5Gbps because the top of the controller's block diagram is a 3.2 Gen 1, but when USB Type-C Gen 2 NICs hit they'll rip along at around 7-8Gbps, pulling large built images down from the Synology and writing it to their SSDs (980 Pros) in well under 10 seconds.
Scary stuff though is the virtualized Spark cluster running on my workstation. Four Intel D7-P5510s in RAID10. With ~25GB/sec of sequential reads you're not held up by storage anymore. Just the network when you want to write out results, and any suboptimal code to ensure you don't starve the CPU cores because you're not ripping through memory fast enough.
The fast new reality is great. Join in. :)