5 ms·
First, the reason the "peak hourly retrieval rate" of "1 gigabyte per hour" is there in the article is to answer this question. At a relative allowance of 5.12
by ratzkewatzke 14y ago
First, the reason the "peak hourly retrieval rate" of "1 gigabyte per hour" is there in the article is to answer this question. At a relative allowance of 5.12 GB/day and 1 GB/hour transfer rate, that gives you a "peak hourly retrieval" of .79 GB (at 5.12/24, your first .21 is free), and so we multiply:
.79 * 720 * .01
Giving me a little less than $6.
Now, do you think Amazon is likely to think they can get away with selling a service that charges you $22k for a 3TB retrieval?
Second, you have ranged GETs and tape headers; use them to avoid transferring all of your data out of the system at once. [Edit: looks like ranged GETs are on job data, not on archival retrieval itself. My bad.]
- digeridoo 14y agoAt 1GB/hour retrieving a 3TB archive takes 6 weeks...
- ratzkewatzke 14y agoSo multiply it by your download speed. Let me know when you get to $22k.
- digeridoo 14y agoAt 10Gbps I can retrieve 3TB within an hour.
- TylerE 14y agoIf you can afford 10Gbps to the internet, $22k is probably chump change.
- ironchef 14y agoI would hope he's talking about direct connect (http://aws.amazon.com/directconnect/ http://aws.amazon.com/directconnect/) as otherwise, you're correct.
- digeridoo 14y ago10Gbps EC2 instances start at $0.742/hour. Welcome to the cloud. ;-) I assume the cost is in retrieval though and counted per the Job Creation API, regardless of whether and how quickly you download the data. but you're right that the 3TB/hour use-case is very hypothetical. Internet archival is just not suitable for those kind of volumes. I think the point OP was making that mistakes like using archives that are too large, or requesting many at once could cost you a lot.
- TylerE 14y agoWell, yes and no. If you actually USE 10gpbs your data transfer bill is going to be around $167k per month (That's for transferring 3.34PB). Actually, a bit higher than that since I calculated all based on the cheapest tier EC2 will quote on the web, 5 cents per gigabyte. For a one time 3TB download to an EC2 instance, priced at the first pricing tier of $0.12/gigabyte, that transfer will cost $360, and take around 40 minutes.
- digeridoo 14y agoGlacier to EC2 traffic is free if your instance is in the same region as the Glacier endpoint and $0.01/GB otherwise.
- MichaelGG 14y agoAfford a 10Gbps connection? You can buy 1Gbps transit for under $1/Mbps, and much less at 10Gbps. So, with a monthly bill of, say, $5K, for the 10Gbps IP, $22k is not quite "chump change".
- xyzzyz 14y agoYou can afford 1Gbps for as little as $70/mo. Currently only in Kansas City, but it will probably expand to other cities soon.
- TylerE 14y agoThat's a 1Gbps connection. Try sustaining 1Gpbs and see if you don't start getting nastygrams. There is a huge difference between a residential connection with a peak speed of X and an X speed connection.