4 ms·
This is probably a big deal, if it's anything like the local SSD storage on GCE. The performance of local SSDs on Google Cloud is nearing absurd compared to any
by jchw 9y ago
This is probably a big deal, if it's anything like the local SSD storage on GCE. The performance of local SSDs on Google Cloud is nearing absurd compared to anything else you can find right now.
That being said, I think one of the less compelling parts of this is that it'll probably vary per instance type quite a bit, being limited to C5 to start, so if you have a workload needing way better disk I/O than CPU performance, you might have to waste. That's one thing GCP really does have on AWS, better granularity.
- runesoerensen 9y ago> being limited to C5 to start I3 and F1 instances also have NVMe SSD instance store volumes https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ssd-instance-store.html#nvme-ssd-volumes https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ssd-inst... Here's the full list of instances with instance storage: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/InstanceStorage.html#instance-store-volumes https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/Instance...
- jchw 9y agoNice, didn't know that.
- foobarbazetc 9y agoThe sequential write performance of local NVME on GCP is... not great.
- jchw 9y agoWould love some benchmarks, if you happen to have them. Frankly, I don't have any good benchmarks directly comparing GCP and AWS, but my current heuristics is that GCP "seems" to have better I/O and AWS "seems" to have higher frequency CPUs. Could be way off.
- jread 9y agoWith more instance types and storage classes, EC2 offers a much wider spectrum of performance capabilities for CPU, storage (ephemeral and durable), and networking.
- jchw 9y agoI don't see how this has to do with my question about benchmarks of sequential disk I/O on GCP instances with local NVMe SSDs. Did you respond to the wrong message? Either way, I use both GCP and AWS but I am finding that I'm spending less on GCP. I don't believe every workload will be cheaper in GCP, but it is clearly competitive at least.
- jread 9y agoI'm responding to your comment "GCE seems to have better I/O and AWS seems to have higher frequency CPUs" - this isn't true. You can get faster I/O, networking and CPU with EC2 if you select the correct instance/storage and are willing to pay for it.
- jread 9y agoFor seq read/write I've observed up to around 15000/2900 MB/s on i3.16xl and 2750/1400 MB/s on GCE w/4xlocal SSD
- jchw 9y agoThis is lacking in details: - What OS image(s) were used? This would aid in reproducibility. - What tool was used for benchmarking? Preferably with the configuration so I could reproduce it. - What GCE instance is used? I assume you will bottleneck on something other than I/O if comparing a very small GCE instance to a very large AWS instance. I will probably benchmark this on my own at some point now that my interest is piqued, but if you have already done the work to benchmark this I'd love to hear more. So far though it's too vague for me to use meaningfully. Is there a blog post or other material that is publicly accessible? I've Googled for such before but come up surprisingly empty handed.
- jread 9y agoGCE local SSD was the fastest thing around when first released in 2014, but hasn't improved and has since fallen behind. GCE local SSD 4k read IOPs max out at around 200k/volume and 800k/instance w/4 volumes. I haven't measured c5 local nvme yet, but on i3, local nvme volumes run at 100-400k/volume and up to 3.3 million IOPs on the largest instance type (i3.16xl).
- jchw 9y agoHey, you seem to know a lot about this. Can you explain why the docs seem to claim they max out at 680k/volume read IOPS and 360k/volume write IOPS? They seem to be talking about 4k blocks. https://cloud.google.com/compute/docs/disks/performance#type_comparison https://cloud.google.com/compute/docs/disks/performance#type... Is Google being disingenuous? I haven't benchmarked it, but I will say that anecdotally the GCP local NVMe SSDs feel very fast for things like building software compared to other setups I've done on other clouds (AWS, UpCloud.)