4 ms·

Posted on brightbox.com. Surely this post won't be biased in the least.

by RKearney 14y ago

jeremyjarvis 14y ago
They're open source benchmarks, try them yourself if not convinced :)
- RKearney 14y ago
  Well also in the price comparison they forgot to mention EC2 offers reserved instances. A Brightbox instance would cost $466 USD a month, and an EC2 reserved c1.xlarge instance would cost $102 a month with a 3 year reserved instance. If you average out the cost to reserve an instance over 3 years, the total would be $188 a month, This means EC2 is actually 60% cheaper than Brightbox.
  - jeremyjarvis 14y ago
    This is clearly a comparison of on-demand instances, where the common unit is the hourly rate as with other IaaS. Reserved instances in themselves have a cost in terms of commitment or risk (if you aren't able to sell them back later).
comice 14y ago
hehe, sure, but the phoronix test suite is open source. Trivially easy to reproduce the results. (like literally a couple of commands and a few tens of pennies of server time).
kev009 14y ago
The pgbench score is conspicuously missing too, which is heavily disk dependent, which is universally heavily over-subscribed by VPS providers. There's a smokescreen at the end "our storage is hardware RAID6 with 15k rpm SAS disks" which means very little. (i.e. if that's internal storage across 8 spindles, it's barely going to sustain 1000 IOPS in anger. That could be monopolized by a just a handful of VMs) This link should be buried.
- comice 14y ago
  I ran these benchmarks myself. The pgbench score just failed to run - I tried a few times but it wouldn't even start. I put it down to a bug in the benchmark. Should have explained. But yeah, no diskio tests here really (other than the pgbench one, but I don't know to what extent that would have tested diskio). The benchmark suite tests were chosen by Phoronix. We'll do a diskio one at some point too.
  - mryan 14y ago
    pgbench will only stress your disks if the test database is too large to fit entirely in memory (controlled by the scaling factor option). bonnie++ results would also be interesting.

Posted on brightbox.com. Surely this post won't be biased in the least.

jeremyjarvis 14y ago

They're open source benchmarks, try them yourself if not convinced :)

RKearney 14y ago
Well also in the price comparison they forgot to mention EC2 offers reserved instances. A Brightbox instance would cost $466 USD a month, and an EC2 reserved c1.xlarge instance would cost $102 a month with a 3 year reserved instance. If you average out the cost to reserve an instance over 3 years, the total would be $188 a month, This means EC2 is actually 60% cheaper than Brightbox.
- jeremyjarvis 14y ago
  This is clearly a comparison of on-demand instances, where the common unit is the hourly rate as with other IaaS. Reserved instances in themselves have a cost in terms of commitment or risk (if you aren't able to sell them back later).

comice 14y ago

hehe, sure, but the phoronix test suite is open source. Trivially easy to reproduce the results. (like literally a couple of commands and a few tens of pennies of server time).

kev009 14y ago

The pgbench score is conspicuously missing too, which is heavily disk dependent, which is universally heavily over-subscribed by VPS providers. There's a smokescreen at the end "our storage is hardware RAID6 with 15k rpm SAS disks" which means very little. (i.e. if that's internal storage across 8 spindles, it's barely going to sustain 1000 IOPS in anger. That could be monopolized by a just a handful of VMs) This link should be buried.

comice 14y ago
I ran these benchmarks myself. The pgbench score just failed to run - I tried a few times but it wouldn't even start. I put it down to a bug in the benchmark. Should have explained. But yeah, no diskio tests here really (other than the pgbench one, but I don't know to what extent that would have tested diskio). The benchmark suite tests were chosen by Phoronix. We'll do a diskio one at some point too.
- mryan 14y ago
  pgbench will only stress your disks if the test database is too large to fit entirely in memory (controlled by the scaling factor option). bonnie++ results would also be interesting.