4 ms·
Ask HN: Have You Migrated from AWS S3 to Cloudflare R2?
If so, how did you do it? How did it go? How are the savings? I have TBs of data I need to progressively replicate to R2. The original blog post on R2 talked about an automatic migration tool for S3 to R2, but I find no mention of it anywhere outside of that blog post.
- edmundsauto 4y agoHow often do you use bandwidth use from those TB? IIRC, s3 can be cheaper b/c of the tiered service options, but if you are eating in the bandwidth bill from amazon, you may see joy from R2.
- prirun 4y agoBeware: the S3 tiered options also have additional fees, like minimum object sizes and minimum object lifetimes. For example, in a situation where a file is getting frequently overwritten, it will cost more to store it in one of the "lower priced" tiers than in regular S3.
- ericpauley 4y agoIntelligent tiering doesn’t have this multi-write issue. For the most part it’s a guaranteed win over standard tier for objects above 128k.
- chrisandchris 4y agoWe migrated from S3 to Minio, an S3-compatible storage. However, we mostly store backups (6-8 TB) there so we don't care about five 9s or performance that much (if we get 80% out of it, it is good enough). Pricing is far better with that amount of data if you self-host.
- mritzmann 4y ago> We migrated from S3 to Minio Hosted/SaaS Minio or self hosted?
- chrisandchris 4y agoSelf-hosted
- anoojb 4y agoWhat kind of project would you use to self-host?
- chrisandchris 4y agoWe use colocation, because it's the best $/GB one can get. Maintenance overhead is small, a couple of hours per month.
- decide1000 4y agoWe moved from Minio to Wasabi. Big improvement in costs.
- xrd 4y agoMeaning, you were paying minio, now using wasabi? You weren't self hosting, right? If you were self hosting, I'm curious how wasabi is cheaper than minio.
- decide1000 4y agoThe costs per TB for self hosting is more expensive as what I pay now at Wasabi. Take in account (redundant) disks and power
- chrisandchris 4y agoMinio SaaS?
- andrewstuart 4y agoIt’ll cost you $90 per terabyte to exit from S3. If I’m reading this right, the first 100GB per month out of AWS is now free? https://aws.amazon.com/about-aws/whats-new/2021/11/aws-price-reduction-data-transfers-internet/ https://aws.amazon.com/about-aws/whats-new/2021/11/aws-price... So you can subtract $9.
- killingtime74 4y agoOnly if you are small enough to be paying full price, in which case how do you have that much data?
- andrewstuart 4y agoCan you explain what you mean? How much do you think companies pay for data egress from AWS?
- killingtime74 4y agoCan't disclose specifics but if you look around on internet (AWS EDP) you can see organizations that have a certain level of spend have massive discount on egress/S3 storage pricing. Discount on top of the tiered pricing. e.g. US Ohio: Greater than 150 TB / Month $0.05 per GB, then another XX% on top of that.
- whoknew1122 4y agoDepending on your monthly spend, you can get private pricing agreements for most AWS services. But I can't really get into numbers because I like being employed.
- qeternity 4y agoTerabytes of a data is small. You’re not getting discounts from Amazon at that scale.
- ignoramous 4y agoFor this reason, we now switch between sources in s3 and r2. Any artifact stored after 1666666666666 (25 Oct 2022) is in r2 for us (yeah, we universally include timestamp in s3/r2 keys/prefixes).
- jakedata 4y agoYou can implement compression in an AWS Lambda function. You might save some money by compressing your data before egress. I don't know if R2 has a similar unzip function.
- is_true 4y agoprobably with a worker you can pull that off
- zmj 4y agoR2's compatibility with the S3 API still has a ways to go. I tried to port over a relatively trivial app written on the AWS SDK and found: * Request header signing is not supported (ok, fine) * Tagging is not supported (showstopper)
- deleted 4y ago[deleted]