3 ms·
Full-access database queries? Indexed queries are going to randomly read blocks and PCIe 5 doesn't help. The only way I've perceived improvements from SSD linea
by jeffbee 4y ago
Full-access database queries? Indexed queries are going to randomly read blocks and PCIe 5 doesn't help. The only way I've perceived improvements from SSD linear access > 4GB/s is when doing gigantic ETL jobs that were not CPU-limited. Unfortunately a lot of ETL jobs are CPU limited and some of the formats I work with are too intensive on the compute side to benefit from faster storage (like GeoJSON, ugh). Formats that are more CPU-friendly also tend to be smaller, making the storage less relevant.
I think for general use most desktop and workstation users are going to get more benefits from faster random access and won't notice very high linear access speeds. I have two recent SSDs and one of them has a median access time of 12µs and the other has a median of 30µs. Even though the latter has gaudy benchmark numbers, can stream at many GB/s and can ultimately hit almost a million IOPS, higher-level application benchmarks lead me to prefer the former because random access waiting time is more important.
- nightski 4y agoI was mainly talking about my usage patterns, not every desktop or workstation user. I work with a lot of data daily. Something more general might be game asset load speed. Those are often sequential reads. They put a ton of engineering effort into the latest consoles simply to improve that one thing.
- wtallis 4y ago> They put a ton of engineering effort into the latest consoles simply to improve that one thing. Most of that effort was to ensure the processors could actually ingest data at the speeds that off the shelf SSDs could deliver it. The Xbox Series X shipped with what was a low-end NVMe SSD at the time, and the PS5 used a custom SSD controller primarily so they could hit their performance targets using older, slower flash memory rather than being constrained by the supply of the faster flash that was just reaching the market at that time. And there are still hardly any games that even make a serious attempt to use the available storage performance.
- deleted 4y ago[deleted]