5 ms·
Few notable things that I didn't realise with Modern SSD. 1. Extremely Power Efficient. They have come a long way with idle power and power management. Even on
by ksec 6y ago
Few notable things that I didn't realise with Modern SSD.
1. Extremely Power Efficient. They have come a long way with idle power and power management. Even on the Desktop where Energy efficiency isn't much of a concern. There used to be a time where SSD are 1W+ even when idling.
2. The amount of idle time, so these IO traces shown most of the time SSD isn't doing anything at all.
3. Read Latency are now extremely good. We are talking about sub 100us and sub 200us in 99th percentile. To the point Optane doesn't provide any meaningful differences in consumer usage. We will find out soon when Billy mentioned he will be testing Optane PX5800, I cant wait to see that. I should also note before someone jump in about Optane's Random Read Write advantage in QD1, I still dont believe it matters in consumer usage beyond the current NAND SSD performances.
I think with coming PCI-E 5.0 Drive we have a roadmap that has pretty much "solved" the performance category if we haven't already done so. What I want to see is slower, but large capacity SSD that is more affordable. But apart from some unforeseeable market condition, I dont see anything on the roadmap or forecast that could bring us 4TB SSD for sub $200 within the next 4 years. We seems to be entering the end of the S Curve where improvement ( cost reduction ) will be slower.
- p1esk 6y agoRegarding Optane and "consumer" usage: If you're talking about a typical PC usage, like browsing, using MS Office, and playing games, then sure, there's absolutely no perceptible difference between Optane and any other SSD, even a SATA SSD. But that's not what people buy Optane for, so it doesn't make much sense testing such an expensive drive on regular "consumer" PC tasks. I train deep learning models, so I read random images from disk to feed data loader pipelines, and I also write back stats, logs, and model checkpoints. I frequently use 8 GPUs, each running a separate experiment, with its own data pipeline. This means every GPU is reading 1.2M jpg images in a random manner, every 30 minutes. I haven't actually tested if the disk reads are a bottleneck, but I'm guessing random reads of 20M images per hour would stress any drive, so I'd rather not risk it and get the best money can buy.
- Dylan16807 6y agoNormal SSDs have more throughput than Optane. Image reads, stats, logs, and checkpoints can all be done asynchronously, so I think a high end flash SSD could very likely perform better for you.
- p1esk 6y agoAccording to benchmarks [1] the older 905p destroys the best "normal" SSD (980 Pro) - it's more than 3 times faster in random reads. As I showed above, in the worst case I'm trying to get up to 2,000MB/s of random reads from my drive. How can you possibly believe a flash SSD can be a better drive for this use case? [1] https://www.anandtech.com/show/16087/the-samsung-980-pro-pcie-4-ssd-review/5 https://www.anandtech.com/show/16087/the-samsung-980-pro-pci...
- Dylan16807 6y agoBut you're not doing 4K reads, and you're not stuck doing them one at a time. The next page, working with 128KB chunks, is far more relevant to your use case. Especially this chart: https://images.anandtech.com/doci/16087/sr-s-905p-1500.png https://images.anandtech.com/doci/16087/sr-s-905p-1500.png Here's a similar benchmark, to prove that it's nothing unique to sequential reads. 256KB random chunks at queue depth 4 go well over 5 gigabytes per second. https://www.legitreviews.com/wp-content/uploads/2020/09/ATTO-2.png https://www.legitreviews.com/wp-content/uploads/2020/09/ATTO... So for the use case of loading image files, with the ability to grab a bunch in parallel, flash seems like a clear winner. It will also write large checkpoint data twice as fast. And the extra microseconds when you're writing to a log shouldn't matter.
- p1esk 6y agoUnfortunately I am stuck doing them one at a time, and every image is located in a different folder. At least that’s how the official Pytorch Imagenet dataloader is reading images for training. You do make a good point though: my reads are not 4k, they closer to 256k on average, but still, they are random reads. I’m not sure how much faster those get with size. And I’m pretty sure doing writes in parallel with those random reads makes things worse, but ok, let’s ignore that.
- wtallis 6y agoJust to clarify: Intel hasn't actually promised me a P5800X yet. But I think it's pretty likely they'll sample it for review eventually. For the P4800X, they initially offered us remote access to test in one of their servers, and later provided a server with a P4800X to keep as my new enterprise SSD testbed. Since I already have some decently powerful PCIe 4.0 machines, I'm not sure I want them to offer another rackmount server that would be too loud to make good use of in the home office.