3 ms·
s3 seems great for scaling out storage, but I'm sure there are gotchas. I work in a very different area, but my experience with ec2 are you should drop what yo
by x0x0 13y ago
s3 seems great for scaling out storage, but I'm sure there are gotchas.
I work in a very different area, but my experience with ec2 are you should drop what you're doing and immediately price out leaving. Roughly: for big hadoop tasks, ec2 is a horrid environment. The boxes are slow, flaky, and shitty; the network is slow and super shitty; and everything about the experience is ass. Oh, and the emr admins are assholes who push broken code; code that couldn't even have run once. These assholes, after issuing us a hotfix to a boot action, proceeded to change the path to the hotfix (without mentioning it to us), breaking our production clusters twice in in 30 hours. I guess I hold a grudge but I like sleeping. The point is emr and perhaps ec2 are complete amateur hour.
Quoting myself earlier:
from a former employer who wants to stay anonymous, ec2 bill per month: $97k
peak, softlayer: $26k. 1/3 the cost, 2x the performance.
And let's not mention emr; a $15k/mo cluster in softlayer did something like
5x the performance of an emr cluster that was costing (and running!) $2k/day.
I'm not kidding about 1/3 the cost and twice the performance. And this wasn't even with rack/switch local boxes, which would improve performance even more.
- zaidf 13y agoI can vouch for your numbers. My music start-up was one of Softlayer's early customers. We stayed with them for a while before moving to an even cheaper host. In all, we were pushing over 100TB and paying under $3,000/mo for everything(web, storage, db servers). This was over 5 years ago. I am sure things would be even cheaper now.
- diziet 13y agoSoft Layer seems to be as expensive as EC2, if not more expensive, especially when compared to reserved instances. The 244gb cr1.8xlarge (16 cpus, 240gb ssd) amortized over 3 years costs $659 / month. Softlayer would charge quite a bit more for similar specs ( order of magnitude more).