2 ms·
PCIe 3 x16 devices have a 16GB/s theoretical max, so 1000GB/s is still out of reach for single machine I/O (though it's not as though search needs anywhere near
by hedora 9y ago
PCIe 3 x16 devices have a 16GB/s theoretical max, so 1000GB/s is still out of reach for single machine I/O (though it's not as though search needs anywhere near these bandwidths anyway).
- scalyr2 9y agohttps://blog.scalyr.com/2014/05/searching-20-gbsec-systems-engineering-before-algorithms/ https://blog.scalyr.com/2014/05/searching-20-gbsec-systems-e...
- joshuamorton 9y agoThat blog seems to imply you're using a distributed architecture, ie. not a single machine.
- colechristensen 9y agoThe Intel i9-7900x has 44 PCIe 3.0 lanes and wikipedia tells me each lane has throughput 984.6 MB/s so there's ~40 GB/s, maybe fast compression could make a small integer multiple. https://www.intel.com/content/www/us/en/products/processors/core/x-series/i9-7900x.html https://www.intel.com/content/www/us/en/products/processors/...
- brodock 9y agoAMD Threadripper has 64 in all available models: https://en.wikipedia.org/wiki/Zen_(microarchitecture) https://en.wikipedia.org/wiki/Zen_(microarchitecture)