4 ms·

OP here. We'd like this work to be a useful resource - everyone benefits when there's more / better information about how these complex cloud systems perform in

by snewman 14y ago

OP here. We'd like this work to be a useful resource - everyone benefits when there's more / better information about how these complex cloud systems perform in real life. So please comment with suggestions, questions, or any other feedback!

darkarmani 14y ago
I wish you tested with larger numbers of EBS volumes. I've just started researching EC2 and EBS, and the links I saw seemed to indicate that large numbers of EBS volumes with raid0 smooths out the performance (8,16,24 volumes). http://orion.heroku.com/past/2009/7/29/io_performance_on_ebs/ http://orion.heroku.com/past/2009/7/29/io_performance_on_ebs... The graphs are very well done. That amount of data would have been incomprehensible if not for your carefully thought out charts.
- snewman 14y ago
  Thanks. I did put in quite a bit of work in finding the best ways to present the data, which depending on how you count is around five- or six-dimensional. I'll see whether we can work larger RAID configurations into a follow-up.
mrkurt 14y ago
I found it interesting, but have to admit I scanned through to read about provisioned IOPs almost right away and was disappointed that there weren't any benchmarks.
- snewman 14y ago
  Yes -- unfortunately, Amazon announced provisioned IOPs approximately the day after we finished the benchmarking work. It took a while to find time to write up the results. We'll very likely do a followup post to test provisioned IOPs. If anyone has other suggestions to include in the followup work, please let us know.
  - mrkurt 14y ago
    I figured! I am very curious how much "EBS Optimized" instances help, mostly with provisioned IOPs.
    - rbc 14y ago
      "EBS Optimized" instances dedicate an extra 1 GigE interface just for EBS IO. If your application causes contention between it's service and EBS IO, "EBS Optimized" instances may be for you. Unfortunately, I haven't seen any benchmarking on it yet.
mkup 14y ago
I wish this article had some comparison of AWS I/O (both ephemeral and EBS) to the real hardware (some average HDD and SSD, maybe RAID-1) in terms of random R/W throughput, sequential R/W throughput, single thread random IOPS, multithread random IOPS.
joeshaw 14y ago
I'd love to see a similar set of benchmarks (or perhaps the same one) run on other cloud providers like Rackspace, Linode, etc. Any chance of seeing the nitty gritty details up on Github?

by snewman 14y ago

darkarmani 14y ago

I wish you tested with larger numbers of EBS volumes. I've just started researching EC2 and EBS, and the links I saw seemed to indicate that large numbers of EBS volumes with raid0 smooths out the performance (8,16,24 volumes). http://orion.heroku.com/past/2009/7/29/io_performance_on_ebs/ http://orion.heroku.com/past/2009/7/29/io_performance_on_ebs... The graphs are very well done. That amount of data would have been incomprehensible if not for your carefully thought out charts.

snewman 14y ago
Thanks. I did put in quite a bit of work in finding the best ways to present the data, which depending on how you count is around five- or six-dimensional. I'll see whether we can work larger RAID configurations into a follow-up.

mrkurt 14y ago

I found it interesting, but have to admit I scanned through to read about provisioned IOPs almost right away and was disappointed that there weren't any benchmarks.

snewman 14y ago
Yes -- unfortunately, Amazon announced provisioned IOPs approximately the day after we finished the benchmarking work. It took a while to find time to write up the results. We'll very likely do a followup post to test provisioned IOPs. If anyone has other suggestions to include in the followup work, please let us know.
- mrkurt 14y ago
  I figured! I am very curious how much "EBS Optimized" instances help, mostly with provisioned IOPs.
  - rbc 14y ago
    "EBS Optimized" instances dedicate an extra 1 GigE interface just for EBS IO. If your application causes contention between it's service and EBS IO, "EBS Optimized" instances may be for you. Unfortunately, I haven't seen any benchmarking on it yet.

mkup 14y ago

I wish this article had some comparison of AWS I/O (both ephemeral and EBS) to the real hardware (some average HDD and SSD, maybe RAID-1) in terms of random R/W throughput, sequential R/W throughput, single thread random IOPS, multithread random IOPS.

joeshaw 14y ago

I'd love to see a similar set of benchmarks (or perhaps the same one) run on other cloud providers like Rackspace, Linode, etc. Any chance of seeing the nitty gritty details up on Github?