3 ms·
I love how exponential growth can be utterly terrifying or unfathomably amazing. Just a few years ago I was trying to explain to an IT manager that 200 IOPS ju
by jiggawatts 5y ago
I love how exponential growth can be utterly terrifying or unfathomably amazing.
Just a few years ago I was trying to explain to an IT manager that 200 IOPS just doesn’t cut it for their biggest, most important OLAP database.
He asked me what would be a more realistic number.
“20,000 IOPS is a good start”
“You can’t be serious!”
“My laptop can do 200,000.”
- KennyBlanken 5y ago> Just a few years ago > “My laptop can do 200,000.” Only now (PCIe 4 and very recent controllers etc) are the very latest top-end NVME drives hitting around 150k IOPS (which isn't stopping manufacturers from claiming ten times that; WD's NVME drive tests at around 150-200k IOPS and yet they claim 1M) and only in ideal circumstances...reads and writes coming out of the SLC cache, which typically under 30GB, often a lot smaller except in the highest-end drives. Many drives that claim to reach that sort of performance are actually using Host Backed Cache, ie stealing RAM. IOPS on SSDs drops precipitously once you exhaust any HBC, controller ram, SLC cache, mid-level MLC cache...and start having to hit the actual QLC/TLC. In the case of a very large database, a lot of IO would be outside cache (though certainly any index, transaction, logging, etc IO would likely be in cache.)
- Cullinet 5y agoI would love to pick up from the 200k IOPS laptop quote and demo a RAM drive and then saturate the RAM drive into swapping - I don't know how you could do this on stock distros or Windows but it would make a great executive suite demo of the issues.
- wtallis 5y agoMore than 500k IOPS was downright common for PCIe gen3 SSDs. 1M IOPS is totally achievable with one high-end gen4 SSD. If you meant IOPS with a queue depth of one, or sustained write IOPS, then you need to specify those extra conditions before calling vendors liars. No high-end drives implement the NVMe Host Memory Buffer feature, let alone rely on it for maximum performance. You can buy an Enterprise QLC drive that is fully capable of 800k IOPS for reads. TLC drives that can do twice that are available. Those drives don't have SLC caching.
- Spooky23 5y agoIt really is something else. I used to run a scaled out Exchange system circa 2008, and we spent alot of time optimizing I/O. I think 150 iops was the target per disk performance.