4 ms·
> Its reliance on frequent random access patterns makes it incompatible with the sequential access nature of disk storage. So use SSD? Are people seriously st
by tw04 2y ago
> Its reliance on frequent random access patterns makes it incompatible with the sequential access nature of disk storage.
So use SSD? Are people seriously still trying to use spinning disk for database workloads in 2024?
- JoeAltmaier 2y agoData farms are all about cost per GB. Spinning media is a fraction of the cost per.
- jandrewrogers 2y agoAn SSD does not solve the problem of page fault chasing, it just makes it slightly less bad. This is fundamentally a software architecture problem. This is solved with latency-hiding I/O schedulers, which don’t rely on cache locality for throughput.
- redskyluan 2y agoEven SSD won't be fast enough for most indexes due to the random access nature. I've seen more than 1M iops on a huge nvme disk when use DiskANN index
- VoVAllen 2y agoHi, I'm the author of the article. The sequential access pattern of IVF makes prefetching and large block sequential reads much easier, whereas it's almost impossible for HNSW to achieve efficient prefetching.