9 ms·
This is great, but I’m disappointed Backblaze B2 isn’t included. That seems like an oversight unless someone can point out how B2 doesn’t hold its own with thes
by dsacco 9y ago
This is great, but I’m disappointed Backblaze B2 isn’t included. That seems like an oversight unless someone can point out how B2 doesn’t hold its own with these options in a glaring way. There are tradeoffs, but B2 seems to be very competitive overall.
B2 is cheaper than every option here for both storage ($0.005/GB) and egress ($0.01/GB).[1] Their transaction pricing is also cheaper.[2] Despite being cheaper, it’s still hot storage, so you can immediately download buckets, in whole or in part. I’ve personally used it to backup (and restore) terabytes of data for over a year. I doubt it has an SLA like GCP or AWS, but DigitalOcean doesn’t either, yet it’s listed here. I find the B2 API documentation to be very readable as well.[3]
I’ve used AWS S3, Glacier and GCP Nearline, Coldline. I can’t think of a specific thing that has disappointed me about B2, and the reliability has been excellent. The nature of my work is that I have very large datasets, and B2 becomes extremely competitive when you’re backing up tens of terabytes or more.
_________________________________
1. https://www.backblaze.com/b2/cloud-storage-pricing.html https://www.backblaze.com/b2/cloud-storage-pricing.html
2. https://www.backblaze.com/b2/b2-transactions-price.html https://www.backblaze.com/b2/b2-transactions-price.html
3. https://www.backblaze.com/b2/docs/ https://www.backblaze.com/b2/docs/
- truetraveller 9y agoI really wanted to like B2. I love the docs and super-clean interface. But B2 was just too "weird" when it came to uploading an object. You can't replace an object key, so you always get a new object key when uploading. This is unlike any normal object store, where you can just upload to an existing key. Also, if you upload an object with the same name (e.g. myphoto.png) it creates a new version, and there's no way to stop this. I don't want or need a new version! I have a feeling this restriction is in place because of the underlying "vault" implementation.
- beepbeepbeep1 9y agoB2 is great as a backup store. I use it for backup. I wouldn't use it for non backup object storage, as it's in a single data center. S3 and Google Cloud are completely different, I'm not sure on the Google specifics but S3 has data replicated across three AZs.
- yjftsjthsd-h 9y agoIsn't backing up the last place where you want zero redundancy?
- zwily 9y agoA backup has redundancy already - your local copy + the backup. (edit: I’m talking about geographic redundancy. B2 does use redundancy inside the datacenter to protect from drive failure, etc)
- jnsaff2 9y agoI guess what OP meant was that for backups durability is important and periods of downtime are not as crucial as for say catpicturegram.
- corobo 9y agoIn fairness backing up is the last place I want to hand over redundancy responsibility. Better I consider B2 as one part of the 3-2-1 backups than the be-all end-all
- linsomniac 9y agoI don't know about that. In my case I'm backing up a backup, so I have to lose both backups. B2 is just for the offsite copy of the backup. Like taking a tape home sometimes...
- puzzle 9y agoGCS has multi-AZ replication, but also multi-region (at a premium).
- mayank 9y agoS3 also does eventually consistent multi-region replication (at a premium).
- 3pt14159 9y agoI'm on DigitalOcean, and I love it, but I use B2 for backup because it just naturally seems safer to have the backups with a different company. It is great for that. I found the object upload a bit weird / different, but I appreciated how it stops you from shooting yourself in the foot by default, rather than the other way around.
- arghwhat 9y agoIf you upload an object with the same 'name' to S3, you also get a new version. When you say 'key', do you mean the opaque object ID granted to objects in B2 which object stores like S3 doesn't have at all? I don't understand the rant here. S3 only operate by 'name' (key). I have had no problem integrating B2 side-by-side with S3 and GCP in the products I have written. Their high-level models are largely compatible.
- zedpm 9y agoS3 allows you to turn versioning on and off for a bucket; my understanding is that B2 does not.
- arghwhat 9y agoYeah, that's correct. You have to delete old versions manually after upload if you want to simulate an "overwrite". It would be quite simple for backblaze to implement, though, so I guess it might come as a future option.
- mayank 9y agoS3 versioning is optional and off by default. Writes (including rewrites) to S3 are also atomic, so you’ll never see partial writes.
- arghwhat 9y agoAh, fair enough. I have oddly enough never in my life written to the same key twice, so I hadn't noticed it was off by default for S3. Just to clarify you statement about atomicity: All writes to S3 and B2 are 'atomic' (and B2 can also verify the hash and reject on failure for an extra layer of security). The difference you mention is just that you can superficially "disable" versioning for S3, so that each key only stores one object version at a given time. The only difference to the upload when S3 versioning is disabled is what happens during the metadata update: With versioning, a version is appended. Without, the version is replaced. For B2, simulating disabled versioning is two operations: Upload a new object, and delete the old one. As long as the object is only referenced by name, this will also be atomic.
- moondev 9y agoBackblaze is in only a single datacenter, so perhaps not quite fair to compare pricing between true multi-region competitors?
- toomuchtodo 9y agoNone of the other multi-region competitors provide multi-region durability "out of the box" (although S3 does offer cross region replication as an option), so you might consider distributing your data between two object stores if you need multi-region (AWS us-east-1 and Backblaze, for example). This ensure not only geographic redundancy, but also vendor redundancy (not to mention B2 is cheaper than S3). Disclaimer: I am in risk management.
- deleted 9y ago[deleted]
- lobster_johnson 9y agoNot sure what you mean by "out of the box". Both Google Cloud Storage and Amazon S3 have cross-region replication built in. Something not "in the box" would imply you have to build it yourself, or buy a vendor product, to get it. Google Cloud Storage's multi-regional support (asynchronously replicated to two or more geographic locations) is even easier than AWS: You simply specify, on bucket creation, whether the bucket should be regional or multi-regional.
- toomuchtodo 9y agoThanks for correcting me on Google Cloud! I wasn't aware, as I work exclusively in AWS. I stand by my statement about the benefit of multi vendor object replication.
- therealmarv 9y agothere are also many other missing.... OVH object storage, online.net C14, Rackspace, Delimiter ObjSpace etc.etc.etc. The world is not only Google, Amazon, Azure and DigitalOcean!
- jopsen 9y agoblob storage without associated compute resources is boring. transfer costs and latency makes it unusable for anything interesting.
- beedrillzzzzz 9y agoA little unfinished, but https://storagestatistics.com https://storagestatistics.com includes backblaze and others
- codemac 9y agoThe "geographic resiliency" chart is pretty inaccurate for the major providers, especially folks like Google cloud that have multi regional offerings with 99.95% availability & a lot more than "1" for redundancy. I'd also add - unless you are going to include a median/mean latency number many options will look absurdly good even though we know they're a horrible idea, e.g. https://en.wikipedia.org/wiki/GmailFS https://en.wikipedia.org/wiki/GmailFS. I also think "unknown" availability looks a lot like a durability issue..