3 ms·
> local storage beats SAN storage massively Only if your (storage) network is slow (eg 1/10/25 GbE). With a decent network (eg modern infiniband, 40+GbE, etc)
by justinclift 8y ago
> local storage beats SAN storage massively
Only if your (storage) network is slow (eg 1/10/25 GbE).
With a decent network (eg modern infiniband, 40+GbE, etc) for the storage, the latency and throughput to the storage shouldn't make a difference.
For example (years ago), I used to set up SSD arrays - SATA at the time, as M.2 wasn't a thing - and have them served over a 20Gbs Infiniband network to hosts in the same data centre.
The access times from an OS perspective to hit that storage over the network were the same as for hitting local disk. But the networked storage was higher bandwidth (multiple SSD's, instead of a single per host).
Worked really well. :)
- justinclift 8y agoFor reference, the SCST project was the software used (back-in-the-day) for high performance block storage over infiniband: http://scst.sourceforge.net http://scst.sourceforge.net Looks like it's still an active project too, as there's a new release listed from November 2018.