The output suggest to me that I should do more benchmarks to avoid another bottleneck, as I seem to be hitting PCIe lanes issues :-) I also want to get my hand

The output suggest to me that I should do more benchmarks to avoid another bottleneck, as I seem to be hitting PCIe lanes issues :-) I also want to get my hands on a few intel Optanes to test how well VROC performs in practice. FYI, here are some previous results where I configured partitions of similar sizes, then assembled them like: (...) mdadm --create --verbose /dev/md6 --level=stripe --raid-devices=6 /dev/nvme[0-5]n1p6 mdadm --create --verbose /dev/md5 --level=stripe --raid-devices=5 /dev/nvme[0-4]n1p5 (...) On repeated benchmarks, the best results were consistently obtained with 5 drives: Testing md5 randwrite: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=16 ... fio-2.1.11 Starting 8 processes Jobs: 8 (f=8): [w(8)] [100.0% done] [0KB/4397MB/0KB /s] [0/1126K/0 iops] [eta 00m:00s] randwrite: (groupid=0, jobs=8): err= 0: pid=76554: Mon Feb 12 01:47:56 2018 write: io=966497MB, bw=4027.4MB/s, iops=1030.1K, runt=240002msec slat (usec): min=1, max=3852, avg= 3.45, stdev= 1.49 clat (usec): min=0, max=17533, avg=119.88, stdev=258.75 lat (usec): min=10, max=17535, avg=123.40, stdev=258.76 clat percentiles (usec): | 1.00th=[ 12], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 27], 40.00th=[ 36], 50.00th=[ 50], 60.00th=[ 71], | 70.00th=[ 106], 80.00th=[ 167], 90.00th=[ 270], 95.00th=[ 366], | 99.00th=[ 1020], 99.50th=[ 1992], 99.90th=[ 3536], 99.95th=[ 3952], | 99.99th=[ 4960] bw (KB /s): min=402136, max=748520, per=12.50%, avg=515423.89, stdev=44403.70 lat (usec) : 2=0.01%, 4=0.01%, 10=0.02%, 20=19.43%, 50=30.18% lat (usec) : 100=18.95%, 250=19.84%, 500=9.14%, 750=1.12%, 1000=0.32% lat (msec) : 2=0.52%, 4=0.45%, 10=0.05%, 20=0.01% cpu : usr=17.59%, sys=50.20%, ctx=50843447, majf=0, minf=71 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0% issued : total=r=0/w=247423104/d=0, short=r=0/w=0/d=0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): WRITE: io=966497MB, aggrb=4027.4MB/s, minb=4027.4MB/s, maxb=4027.4MB/s, mint=240002msec, ma xt=240002msec Disk stats (read/write): md5: ios=0/247193645, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=0/49484620, a ggrmerge=0/0, aggrticks=0/5476932, aggrin_queue=5571618, aggrutil=90.41% nvme0n1: ios=0/49483811, merge=0/0, ticks=0/5518696, in_queue=5613760, util=90.41% nvme4n1: ios=0/49480722, merge=0/0, ticks=0/5573820, in_queue=5663004, util=90.29% nvme1n1: ios=0/49485862, merge=0/0, ticks=0/5390388, in_queue=5483560, util=90.07% nvme2n1: ios=0/49488566, merge=0/0, ticks=0/5395484, in_queue=5496916, util=90.12% nvme3n1: ios=0/49484143, merge=0/0, ticks=0/5506276, in_queue=5600852, util=90.30%