7 ms·

Amazon S3 Price Reduction

146 points by jeffbarr 15y ago

masterleep 15y ago
It's still pretty expensive for archival storage without instant access requirements. Can somebody please do a tape based cloud storage service with slow file access but much cheaper per TB storage costs?
- Tossrock 15y ago
  Do tape drives really still offer better bytes/dollar than HDDs? I'll admit to being unfamiliar with them.
  - whatusername 15y ago
    For certain scales and usage patterns. a 1.5TB* Tape is about $50. However it: (1) should last longer than a HDD and (2) Uses much less power, cooling, floor space, etc. * Tape also has really nice compression (essentially you would be using the on-tape compression at least 95% of the time) with an average of about 2:1 (and often much higher). But you can also compress files on disk -- so it's just native storage. Also -- Things like the SL8500 are such beautiful pieces of machinery. Computers + Robots = Awesome! Editing to Add: LTO5 was released in 2010. LTO6 is likely to arrive this year with 3.2TB Native Capacity. (And the usual speed bumps of 50% Write // 100% Read speed). The roadmap for the tech is here: http://www.spectralogic.com/common/images/products/lto/lto5/LTORoadmapLarge.png http://www.spectralogic.com/common/images/products/lto/lto5/...
    - justincormack 15y ago
      It is hard to find pricing for the equipment, which makes me think it is expensive.but it could still potentially be cost effective. However it seems unlikely to come in at 10% of Amazon, ie at $150 per TB per year. You might be better off building your own robot for this application too, with more storage space. Spun down hard drives would be a similar price. Not necessarily easier to work with.
      - mseebach 15y ago
        I think spun down HDs would be a lot easier. They have standard interfaces which makes them cheap and flexible. Get a bunch of USB 3 docks[1] and some $10/hour clerks to shuffle the drives around. 1: http://www.engadget.com/2010/02/20/sharkoons-usb-3-0-sata-hdd-dock-doubles-up-now-handles-two-dri/ http://www.engadget.com/2010/02/20/sharkoons-usb-3-0-sata-hd...
        justincormack 15y ago
        Forget the clerks and USB. Get the very cheapest USB to ethernet chipset you can, on 100 mb ethernet, and only power it up when you need drive access. You should be able to do that at $10-20 a disk. No moving parts to maintain.
        mnutt 15y ago
        I wonder how much higher rate of failure you'd get with spun-down disks, since starting and stopping is often when they fail.
  - acdha 15y ago
    The big question is scale: tape robot systems are expensive to purchase and somewhat less reliable compared to an HDD so you have significant infrastructure costs bringing up the storage system, establishing a system of off-site rotation and redundancy, testing restores on separate drives (one common failure mode is that a tape drive slowly goes out of alignment, writing data which cannot be read by a calibrated drive), etc. These are great examples of something which could be commodified so a provider could amortize them across many customers but the margins are continually tightening.
- toomuchtodo 15y ago
  http://nimbus.io http://nimbus.io (yeah, not live yet, but at only 6 cents/GB, its worth keeping an eye on)
  - masterleep 15y ago
    Half price is of course better, but for my use case, I want something ten times cheaper. I'm willing to trade convenience and latency for that cost saving. Use case: I want to be able to shoot several minutes of video on my cell phone and keep it backed up in the cloud without feeling like I've incurred a $1/year charge for the rest of my life.
    - joering2 15y ago
      im not sure with todays technology you could go cheaper than 4c/GB for a service like that. Doing it on your own would be $50 for 3TB cartridge == 2c/GB.
      - masterleep 15y ago
        Do you mean 4c/GB/month? The $50 cartridge fee would be non-recurring except for storage.
        joering2 15y ago
        yes you are right! (sorry)
        toomuchtodo 15y ago
        Less recurring, but still recurring. Those tapes wear out eventually.
  - 1qaz2wsx3edc 15y ago
    Usenet Binaries ಠ_ಠ
- jtchang 15y ago
  I wonder how slow you'd be willing to go. Would you be willing to pay $1 for 100GB if it meant waiting 15 minutes to load your tape? How about 30 minutes?
  - ars 15y ago
    $1 per 100GB per what? If it was per year I might do it, certainly not per month.
    - joering2 15y ago
      doing some initial calculation, it may be a ground for startup if you would be willing to pay $2.50/year for 100GB with first 10GB/year free download.
  - toomuchtodo 15y ago
    Yes. If I could pay $10/TB/month, request a list of files via API, and be notified via webhook when I could retrieve them (and therefore, retrieve them while they're cached on spinning media for 24 hours), I'd definitely do it. I've got tons of video, pictures, and music to back up, and I don't need immediate access to backups.
    - joering2 15y ago
      I was looking into your problem. Just out of curiosity: even if you produce 100GB per day, what stops you from purchasing a 3TB (compressed) tape[1] for $54 and do backups on your own and store cassette offsite in your secure deposit box (some banks give those for free, or $30/year) 1: http://www.newegg.com/Product/Product.aspx?Item=N82E16840999258 http://www.newegg.com/Product/Product.aspx?Item=N82E16840999... just trying to figure if there is any business behind your problem.
      - masterleep 15y ago
        If a personal backup solution requires manual steps, it will eventually stop happening.
- deleted 15y ago
  [deleted]
- Yrlec 15y ago
  My start-up (http://degoo.com http://degoo.com) is working on a P2P backup system that I think will match your requirements quite well. We are launching our beta tests within next couple of months. </shamelessplug>
  - smokinn 15y ago
    You don't really need the plug tags. HN is generally quite receptive to self-advertising of on-topic personal startups.
    - Yrlec 15y ago
      Ok, thanks for the notice. I had a feeling that was the case but better safe than sorry. Don't want to come of as "spammy".
- reidrac 15y ago
  There are other providers that are definitely cheaper. Specially thanks to OpenStack Object Storage you can find different services with the same API, so you have an open door to leave any time. ie. my employer offers a OS based service (slightly lower rates, upload is free, based in UK): http://www.memset.com/cloud/storage/ http://www.memset.com/cloud/storage/
- Terretta 15y ago
  How much content and how much cheaper? And what about access via rsync instead of "tape based"?
afhof 15y ago
I've never understood why they use a stair step function for pricing. Why not just name a continuous function for pricing and simplify the scheme?
- shingen 15y ago
  They specifically want to economically encourage bringing the house with you to get the cheapest rate (total commitment); or encourage building a larger house than you might otherwise have. A continuous function of price reduction per unit, rewards everyone as they go; Amazon very specifically doesn't want to do that (users gain benefit at every step, and are rewarded just for being at any given metric, encouraging no particular scale or usage). The price points are supposed to be mental carrots, in other words. It can of course be debated which approach is better, but I have to suspect Amazon has a lot of data on scaling and pricing from retail behavior.
  - match 15y ago
    Yes and no. Correct me if I'm wrong but tipping over into the text tier doesn't change the price of the previous data, only the data that's in the next tier.
    - jeffbarr 15y ago
      You are correct.
    - corin_ 15y ago
      That of course impacts the total cost you'll pay, but it doesn't change the fact that the more you use, the lower your average cost per GB is.
      - Terretta 15y ago
        But there's no benefit from rushing ahead.
- notaddicted 15y ago
mthreat 15y ago
This is good news. Now if they would lower their EC2 instance pricing, especially large RAM instances!
libria 15y ago
Interesting. That puts them from just above below Google's Cloud Storage to just below, https://developers.google.com/storage/docs/pricingandterms#pricing https://developers.google.com/storage/docs/pricingandterms#p.... I didn't even think GCS was on their radar.
- justincormack 15y ago
  Amazon started cutting prices long before there was any competition. I dont think this is due to Google, as for most people the difference in network costs depending if you use EC2 matters more. It is probably more to do with hard drive prices renormalizing after the flooding...
ellie42 15y ago
What about Rackspace Cloud Files? http://www.rackspace.com/cloud/cloud_hosting_products/files/pricing/ http://www.rackspace.com/cloud/cloud_hosting_products/files/...
- justincormack 15y ago
  What about it? It was more expensive, and now looks worse. If you host at rackspace though the network costs will make it cheaper.
- NARKOZ 15y ago
  See comparison[1]. It's still cheaper than Amazon. They don't charge for requests and incoming bandwidth. 1: http://www.rackspace.com/cloud/cloud_hosting_products/files/compare/ http://www.rackspace.com/cloud/cloud_hosting_products/files/...
  - RKearney 15y ago
    Amazon also does not charge for inbound bandwidth. I'm not sure what you're getting at. They also had to do the comparison with the additional support package from Amazon to inflate the price to make their pricing model look more appealing.
    - jdelsman 15y ago
      (Bandwidth prices not withstanding.) 10,000,000,000 GET requests on Amazon = $1,000.00 (0.01/10000 reqs) 10,000,000,000 GET requests on Rackspace = $0.00 (FREE) 1,000 GB on Amazon = $125.00 (0.125/gb) 1,000 GB on Rackspace = $150.00 (0.15/gb) Total Amazon: $1,250.00 Total Rackspace: $150.00 That's what he's getting at.
      - match 15y ago
        Damn, that's a lot of GETs if you're just doing backup. What's up with that?
      - deleted 15y ago
        [deleted]
wlll 15y ago
I graphed the old and new prices so you can see how they compare: http://willj.net/static/amazon_s3_old_and_new_price_comparison.html http://willj.net/static/amazon_s3_old_and_new_price_comparis...
- deleted 15y ago
  [deleted]
jwr 15y ago
What I find slightly worrying is that the cost of EC2 instances does not decrease more with time. DRAM prices have fallen quite a bit since EC2 started, and yet the cost of EC2 remains relatively stable.
- Poiesis 15y ago
  I would imagine that their power costs have not fallen quite as quickly.
  - jwr 15y ago
    Look at EC2 pricing — instance pricing is pretty much a function of RAM size. I realize RAM isn't everything, but it is a large variable factor, with other cost factors either being constant or not growing proportionally fast. I'd still argue that we should see bigger drops in pricing, especially for the large-memory instances.
    - dangrossman 15y ago
      They're really using RAM as a proxy for other real costs. The amount of RAM you allocate is a pretty good predictor for server/VPS utilization -- which means their actual power, bandwidth and hardware replacement costs as you wear out hardware faster. Virtually all unmanaged VPS and dedicated hosting companies make RAM the primary factor in determining the monthly service cost even though the price-per-gigabyte is more each month than it'd cost to buy the physical RAM outright. In other words, it's a mistake to think that the actual cost of RAM is the reason pricing is proportional to RAM size.
      - Drbble 15y ago
        CPU is a better proxy for utilization than RAM, no? CPU uses far more energy than a RAM, and I can write a low CPU web cache in 12GB RAM or a high CPU scientific simulation in L2 cache.
saurik 15y ago
While Amazon keeps reducing the price of storage, I don't think they have ever reduced the price of requests. :( I would have expected the cost of every component of a request (CPU, bandwidth, etc.) would have gone down over time, but it is still 1000 PUT/LISTs per $0.01 (or 10k GETs, also per $0.01). :( (These request costs actually add up quite quickly: I spent something like $8k on PUT/LIST last month. At one point I found out a client library I was using made the horrible decision to verify the bucket existed with a LIST request each time you made a connection; I tracked that down to $70/day I was losing.)

146 points by jeffbarr 15y ago

It's still pretty expensive for archival storage without instant access requirements. Can somebody please do a tape based cloud storage service with slow file access but much cheaper per TB storage costs?

Tossrock 15y ago
Do tape drives really still offer better bytes/dollar than HDDs? I'll admit to being unfamiliar with them.
- whatusername 15y ago
  For certain scales and usage patterns. a 1.5TB* Tape is about $50. However it: (1) should last longer than a HDD and (2) Uses much less power, cooling, floor space, etc. * Tape also has really nice compression (essentially you would be using the on-tape compression at least 95% of the time) with an average of about 2:1 (and often much higher). But you can also compress files on disk -- so it's just native storage. Also -- Things like the SL8500 are such beautiful pieces of machinery. Computers + Robots = Awesome! Editing to Add: LTO5 was released in 2010. LTO6 is likely to arrive this year with 3.2TB Native Capacity. (And the usual speed bumps of 50% Write // 100% Read speed). The roadmap for the tech is here: http://www.spectralogic.com/common/images/products/lto/lto5/LTORoadmapLarge.png http://www.spectralogic.com/common/images/products/lto/lto5/...
  - justincormack 15y ago
    It is hard to find pricing for the equipment, which makes me think it is expensive.but it could still potentially be cost effective. However it seems unlikely to come in at 10% of Amazon, ie at $150 per TB per year. You might be better off building your own robot for this application too, with more storage space. Spun down hard drives would be a similar price. Not necessarily easier to work with.
    - mseebach 15y ago
      I think spun down HDs would be a lot easier. They have standard interfaces which makes them cheap and flexible. Get a bunch of USB 3 docks[1] and some $10/hour clerks to shuffle the drives around. 1: http://www.engadget.com/2010/02/20/sharkoons-usb-3-0-sata-hdd-dock-doubles-up-now-handles-two-dri/ http://www.engadget.com/2010/02/20/sharkoons-usb-3-0-sata-hd...
      - justincormack 15y ago
        Forget the clerks and USB. Get the very cheapest USB to ethernet chipset you can, on 100 mb ethernet, and only power it up when you need drive access. You should be able to do that at $10-20 a disk. No moving parts to maintain.
      - mnutt 15y ago
        I wonder how much higher rate of failure you'd get with spun-down disks, since starting and stopping is often when they fail.
- acdha 15y ago
  The big question is scale: tape robot systems are expensive to purchase and somewhat less reliable compared to an HDD so you have significant infrastructure costs bringing up the storage system, establishing a system of off-site rotation and redundancy, testing restores on separate drives (one common failure mode is that a tape drive slowly goes out of alignment, writing data which cannot be read by a calibrated drive), etc. These are great examples of something which could be commodified so a provider could amortize them across many customers but the margins are continually tightening.
toomuchtodo 15y ago
http://nimbus.io http://nimbus.io (yeah, not live yet, but at only 6 cents/GB, its worth keeping an eye on)
- masterleep 15y ago
  Half price is of course better, but for my use case, I want something ten times cheaper. I'm willing to trade convenience and latency for that cost saving. Use case: I want to be able to shoot several minutes of video on my cell phone and keep it backed up in the cloud without feeling like I've incurred a $1/year charge for the rest of my life.
  - joering2 15y ago
    im not sure with todays technology you could go cheaper than 4c/GB for a service like that. Doing it on your own would be $50 for 3TB cartridge == 2c/GB.
    - masterleep 15y ago
      Do you mean 4c/GB/month? The $50 cartridge fee would be non-recurring except for storage.
      - joering2 15y ago
        yes you are right! (sorry)
      - toomuchtodo 15y ago
        Less recurring, but still recurring. Those tapes wear out eventually.
- 1qaz2wsx3edc 15y ago
  Usenet Binaries ಠ_ಠ
jtchang 15y ago
I wonder how slow you'd be willing to go. Would you be willing to pay $1 for 100GB if it meant waiting 15 minutes to load your tape? How about 30 minutes?
- ars 15y ago
  $1 per 100GB per what? If it was per year I might do it, certainly not per month.
  - joering2 15y ago
    doing some initial calculation, it may be a ground for startup if you would be willing to pay $2.50/year for 100GB with first 10GB/year free download.
- toomuchtodo 15y ago
  Yes. If I could pay $10/TB/month, request a list of files via API, and be notified via webhook when I could retrieve them (and therefore, retrieve them while they're cached on spinning media for 24 hours), I'd definitely do it. I've got tons of video, pictures, and music to back up, and I don't need immediate access to backups.
  - joering2 15y ago
    I was looking into your problem. Just out of curiosity: even if you produce 100GB per day, what stops you from purchasing a 3TB (compressed) tape[1] for $54 and do backups on your own and store cassette offsite in your secure deposit box (some banks give those for free, or $30/year) 1: http://www.newegg.com/Product/Product.aspx?Item=N82E16840999258 http://www.newegg.com/Product/Product.aspx?Item=N82E16840999... just trying to figure if there is any business behind your problem.
    - masterleep 15y ago
      If a personal backup solution requires manual steps, it will eventually stop happening.
deleted 15y ago
[deleted]
Yrlec 15y ago
My start-up (http://degoo.com http://degoo.com) is working on a P2P backup system that I think will match your requirements quite well. We are launching our beta tests within next couple of months. </shamelessplug>
- smokinn 15y ago
  You don't really need the plug tags. HN is generally quite receptive to self-advertising of on-topic personal startups.
  - Yrlec 15y ago
    Ok, thanks for the notice. I had a feeling that was the case but better safe than sorry. Don't want to come of as "spammy".
reidrac 15y ago
There are other providers that are definitely cheaper. Specially thanks to OpenStack Object Storage you can find different services with the same API, so you have an open door to leave any time. ie. my employer offers a OS based service (slightly lower rates, upload is free, based in UK): http://www.memset.com/cloud/storage/ http://www.memset.com/cloud/storage/
Terretta 15y ago
How much content and how much cheaper? And what about access via rsync instead of "tape based"?

afhof 15y ago

I've never understood why they use a stair step function for pricing. Why not just name a continuous function for pricing and simplify the scheme?

shingen 15y ago
They specifically want to economically encourage bringing the house with you to get the cheapest rate (total commitment); or encourage building a larger house than you might otherwise have. A continuous function of price reduction per unit, rewards everyone as they go; Amazon very specifically doesn't want to do that (users gain benefit at every step, and are rewarded just for being at any given metric, encouraging no particular scale or usage). The price points are supposed to be mental carrots, in other words. It can of course be debated which approach is better, but I have to suspect Amazon has a lot of data on scaling and pricing from retail behavior.
- match 15y ago
  Yes and no. Correct me if I'm wrong but tipping over into the text tier doesn't change the price of the previous data, only the data that's in the next tier.
  - jeffbarr 15y ago
    You are correct.
  - corin_ 15y ago
    That of course impacts the total cost you'll pay, but it doesn't change the fact that the more you use, the lower your average cost per GB is.
    - Terretta 15y ago
      But there's no benefit from rushing ahead.
notaddicted 15y ago

mthreat 15y ago

This is good news. Now if they would lower their EC2 instance pricing, especially large RAM instances!

libria 15y ago

Interesting. That puts them from just above below Google's Cloud Storage to just below, https://developers.google.com/storage/docs/pricingandterms#pricing https://developers.google.com/storage/docs/pricingandterms#p.... I didn't even think GCS was on their radar.

justincormack 15y ago
Amazon started cutting prices long before there was any competition. I dont think this is due to Google, as for most people the difference in network costs depending if you use EC2 matters more. It is probably more to do with hard drive prices renormalizing after the flooding...

ellie42 15y ago

What about Rackspace Cloud Files? http://www.rackspace.com/cloud/cloud_hosting_products/files/pricing/ http://www.rackspace.com/cloud/cloud_hosting_products/files/...

justincormack 15y ago
What about it? It was more expensive, and now looks worse. If you host at rackspace though the network costs will make it cheaper.
NARKOZ 15y ago
See comparison[1]. It's still cheaper than Amazon. They don't charge for requests and incoming bandwidth. 1: http://www.rackspace.com/cloud/cloud_hosting_products/files/compare/ http://www.rackspace.com/cloud/cloud_hosting_products/files/...
- RKearney 15y ago
  Amazon also does not charge for inbound bandwidth. I'm not sure what you're getting at. They also had to do the comparison with the additional support package from Amazon to inflate the price to make their pricing model look more appealing.
  - jdelsman 15y ago
    (Bandwidth prices not withstanding.) 10,000,000,000 GET requests on Amazon = $1,000.00 (0.01/10000 reqs) 10,000,000,000 GET requests on Rackspace = $0.00 (FREE) 1,000 GB on Amazon = $125.00 (0.125/gb) 1,000 GB on Rackspace = $150.00 (0.15/gb) Total Amazon: $1,250.00 Total Rackspace: $150.00 That's what he's getting at.
    - match 15y ago
      Damn, that's a lot of GETs if you're just doing backup. What's up with that?
    - deleted 15y ago
      [deleted]

wlll 15y ago

I graphed the old and new prices so you can see how they compare: http://willj.net/static/amazon_s3_old_and_new_price_comparison.html http://willj.net/static/amazon_s3_old_and_new_price_comparis...

deleted 15y ago
[deleted]

jwr 15y ago

What I find slightly worrying is that the cost of EC2 instances does not decrease more with time. DRAM prices have fallen quite a bit since EC2 started, and yet the cost of EC2 remains relatively stable.

Poiesis 15y ago
I would imagine that their power costs have not fallen quite as quickly.
- jwr 15y ago
  Look at EC2 pricing — instance pricing is pretty much a function of RAM size. I realize RAM isn't everything, but it is a large variable factor, with other cost factors either being constant or not growing proportionally fast. I'd still argue that we should see bigger drops in pricing, especially for the large-memory instances.
  - dangrossman 15y ago
    They're really using RAM as a proxy for other real costs. The amount of RAM you allocate is a pretty good predictor for server/VPS utilization -- which means their actual power, bandwidth and hardware replacement costs as you wear out hardware faster. Virtually all unmanaged VPS and dedicated hosting companies make RAM the primary factor in determining the monthly service cost even though the price-per-gigabyte is more each month than it'd cost to buy the physical RAM outright. In other words, it's a mistake to think that the actual cost of RAM is the reason pricing is proportional to RAM size.
    - Drbble 15y ago
      CPU is a better proxy for utilization than RAM, no? CPU uses far more energy than a RAM, and I can write a low CPU web cache in 12GB RAM or a high CPU scientific simulation in L2 cache.

saurik 15y ago

While Amazon keeps reducing the price of storage, I don't think they have ever reduced the price of requests. :( I would have expected the cost of every component of a request (CPU, bandwidth, etc.) would have gone down over time, but it is still 1000 PUT/LISTs per $0.01 (or 10k GETs, also per $0.01). :( (These request costs actually add up quite quickly: I spent something like $8k on PUT/LIST last month. At one point I found out a client library I was using made the horrible decision to verify the bucket existed with a LIST request each time you made a connection; I tracked that down to $70/day I was losing.)