4 ms·

I was hoping for more extensive and definitive. Bandwidth? Latency? Startup time? A meaningful sample with variation from day to day and an idea of variation ac

by ericb 16y ago

I was hoping for more extensive and definitive. Bandwidth? Latency? Startup time? A meaningful sample with variation from day to day and an idea of variation across instances running at the same time? For all the dollars being thrown at EC2, I'm surprised someone hasn't gone nuts with benchmarking this for the authority, notoriety and seo link juice.

snewman 16y ago
I've done some long-running benchmarks of EC2, mostly for kicks and personal edification. For about 8 months now, I've had a job running on an EC2 "small" instance, that performs a suite of microbencharks every 10 seconds and records the results. Lots of raw data can be found here: http://amistrongeryet.com/dashboard.jsp http://amistrongeryet.com/dashboard.jsp This covers a variety of AWS operations, ranging from simple EC2 CPU benchmarks to SimpleDB and RDS operations. I also include some measurements of Google App Engine. I've put a lot of focus on measuring variation over time, and measuring outliers (i.e. 99.9th percentile, not just mean). I'd like to measure variation across instances, but haven't gotten around to it. The web site linked above has no documentation at the moment, and is a bit broken in other ways, but the data may be of interest. I have a little blog (http://amistrongeryet.blogspot.com/ http://amistrongeryet.blogspot.com/) where I've discussed some of my findings, e.g. http://amistrongeryet.blogspot.com/2010/04/early-results-on-gae-and-aws.html http://amistrongeryet.blogspot.com/2010/04/early-results-on-..., http://amistrongeryet.blogspot.com/2010/04/beginnings-of-robust-data-collector.html http://amistrongeryet.blogspot.com/2010/04/beginnings-of-rob..., and http://amistrongeryet.blogspot.com/2010/04/cloud-data-storage-many-choices-all-bad.html http://amistrongeryet.blogspot.com/2010/04/cloud-data-storag.... If there's interest, I'll put a little effort into cleaning up and documenting the data reporting site.
- listic 16y ago
  Hi, I'm definitely interested in benchmarking the EC2 instances. Are you doing some benchmarks that are CPU-intensive? You're measuring the one instance that you've got to use as a server, aren't you? (I'm interested more in, "what perfomance would I keep getting if I keep requesting instances") How can I contact you?
  - snewman 16y ago
    You can reach me at e-mail address "public" on domain "snewman.net". I'd be happy to share more of what I'm doing.

by ericb 16y ago

snewman 16y ago

I've done some long-running benchmarks of EC2, mostly for kicks and personal edification. For about 8 months now, I've had a job running on an EC2 "small" instance, that performs a suite of microbencharks every 10 seconds and records the results. Lots of raw data can be found here: http://amistrongeryet.com/dashboard.jsp http://amistrongeryet.com/dashboard.jsp This covers a variety of AWS operations, ranging from simple EC2 CPU benchmarks to SimpleDB and RDS operations. I also include some measurements of Google App Engine. I've put a lot of focus on measuring variation over time, and measuring outliers (i.e. 99.9th percentile, not just mean). I'd like to measure variation across instances, but haven't gotten around to it. The web site linked above has no documentation at the moment, and is a bit broken in other ways, but the data may be of interest. I have a little blog (http://amistrongeryet.blogspot.com/ http://amistrongeryet.blogspot.com/) where I've discussed some of my findings, e.g. http://amistrongeryet.blogspot.com/2010/04/early-results-on-gae-and-aws.html http://amistrongeryet.blogspot.com/2010/04/early-results-on-..., http://amistrongeryet.blogspot.com/2010/04/beginnings-of-robust-data-collector.html http://amistrongeryet.blogspot.com/2010/04/beginnings-of-rob..., and http://amistrongeryet.blogspot.com/2010/04/cloud-data-storage-many-choices-all-bad.html http://amistrongeryet.blogspot.com/2010/04/cloud-data-storag.... If there's interest, I'll put a little effort into cleaning up and documenting the data reporting site.

listic 16y ago
Hi, I'm definitely interested in benchmarking the EC2 instances. Are you doing some benchmarks that are CPU-intensive? You're measuring the one instance that you've got to use as a server, aren't you? (I'm interested more in, "what perfomance would I keep getting if I keep requesting instances") How can I contact you?
- snewman 16y ago
  You can reach me at e-mail address "public" on domain "snewman.net". I'd be happy to share more of what I'm doing.