3 ms·
Arbitrary configuration networked disk is Hard, probably harder than anything else AWS does. Enterprise still spends a lot on storage (generally big hardware R
by rdl 15y ago
Arbitrary configuration networked disk is Hard, probably harder than anything else AWS does. Enterprise still spends a lot on storage (generally big hardware RAIDs, dedicated storage area networks, etc.). 1 GB of enterprise storage might cost 50-100x the base per-GB cost of the cheapest SATA disk, by the time you include all the costs. No AWS customer wants to pay that much of a premium.
You can often build a storage system for a very specific purpose more more cheaply (maybe 3x the base drive cost?), like the Backblaze pods, or just figure the cost of adding 4-8 x SATA drives and software RAID 10 to each of your servers, but then you get to try to solve the filesystem problem, and have weird performance characteristics. Plus, if you think EBS reliability is bad (it is), wait for the joy of statistically significant number of spinning rust drives in anything not designed with enough redundancy, and where some failures are correlated (trays failing at the same time, controller bugs, ...).
One of Google's big advantages was always their Google File System. And GFS is a lot better for the specific loads in search than for the kind of loads applications like gmail impose.
Local instance storage is really the only performant and cost effective thing. You can hang a lot more direct attached disk off your own server than off any AWS instance (1.7TB).
The other area where AWS kind of falls down is "mad RAM" servers. I can buy 288GB RAM servers (18-slot) cheaply now (well, 144GB is cheap, 288GB is less so), and 2TB RAM is available (64-slot). AWS tops out at 68GB for about 5x the lease payments on these servers (so maybe 2x the loaded cost after Reserved Instance discounts)
- zorked 15y agoMoving from MySQL on EBS to a Cassandra cluster on locally-attached ephemeral storage was the first time I was happy with a database on EC2. EBS is convenient as a permanent root for instances, but for anything that actually uses the disk, it's a pain train. I think of it as a large "pen-drive" for the cloud these days.