27 ms·
Tarsnap price cut
- damian2000 13y agoA link to tarsnap on that page would be a big improvement. http://www.tarsnap.com/ http://www.tarsnap.com/
- cperciva 13y agoThat's... rather embarrassing. Usually I remember to linkify the first time I mention Tarsnap in a blog post. Fixed, thanks!
- damian2000 13y agoNo worries! I only noticed because I was actually looking for it.
- lawnchair_larry 13y agoIt seems that may qualify for one of your bug bounties at the $1 tier. Pay the man!
- cperciva 13y agoI've awarded bug bounties for typos on the Tarsnap website, but my blog is strictly out of scope. ;-)
- pktgen 13y agoTarsnap: Our costs just went down, so we're lowering our pricing for customers too! Comcast: Our costs just went down. Effective immediately, we are adding a new cash management fee to your bill to cover our costs of handling all this new cash.
- icelancer 13y agoI was once billed by Washington Mutual for depositing too much cash with their bank tellers. Can't make this stuff up.
- cperciva 13y ago"You have too much money. Here, we'll help you by taking some of it off your hands..." ?
- icelancer 13y agoThey complained that they had to handle too much physical cash and that there was a limit to how much I could deposit in a given month (into a business account, mind you). I can't think of TOO many more first world problems than that, to be honest...
- throwaway13qf85 13y agoYou realize that they have to pay people to move that cash around, count it, double check it etc, and then they have to pay to store it and maintain it? People don't work for nothing, and storage doesn't cost nothing.
- ama729 13y agoIt would be true if they charged a percent of the money deposited for every dollar, it's not the case here.
- cperciva 13y agoIt might be. My (Canadian) bank's "small business banking" plan charges $2.25 per $1000 of cash deposits beyond the first few thousand/month. (And $2.25 per $100 of coins.) Of course, if I ever deposited cash I would be on a different banking plan; but it's not entirely unheard-of.
- patio11 13y ago
- nodesocket 13y agoWe love tarsnap, easiest and most secure way to offsite our database dumps. No thrills, no beautiful design, just solid software written by cperciva who is a crypto wizard.
- jf 13y agoWhere do I sign up for the Patrick McKenzie surcharge?
- cperciva 13y agoSend me an email. But I'll need to ask Patrick how much of a surcharge I should add -- or wait for the blog post it sounds like he's going to write (https://twitter.com/patio11/status/451262179858083840 https://twitter.com/patio11/status/451262179858083840).
- riffraff 13y agothat would be interesting to read, I guess the slightly less generous/fair option would probably be "we are thus launching a new price layer at .25, new users will be automatically enrolled in this one and you can switch by doing X" This way people who want to actually donate more, or do not have enough of a preference would still give you more money.
- gjm11 13y agoThat's a bit too much like a loyalty penalty for my taste: the default option makes things better for new users than for established customers. (Of course loyalty penalties are commonplace -- from phone companies, car insurers, etc. -- but my mental model of cperciva says he probably doesn't like them.)
- cperciva 13y agomy mental model of cperciva says he probably doesn't like them Exactly true. I was looking at that comment trying to put my finger on why I hated the idea so much, and you're right: It's because it would be a loyalty penalty. I want to be fair to everyone.
- throwaway7767 13y agoAs a customer of about 2 years now, it is much appreciated. I feel much better doing business with corporations when I get the feeling that they do their business fairly. Tarsnap succeeds at this.
- edanm 13y agoSo, I guess it's about time I start using Tarsnap :) No, seriously. What do most people use it for? Simply creating a daily backup of their hard drives? Also, are there any business users who use it to backup an entire organisation's systems? Btw, more on-topic, I'm reminded of this quote, which I love, from Jeff Bezos: "There are two kinds of companies: Those that work to try to charge more and those that work to charge less. We will be the second." I've always thought that was a profound sentiment, and I've always wondered if, in the long run, that's the way to make a business survive.
- matteotom 13y agoI only use it to backup configs and game saves. So far, I've used less than $0.05, backing up 73M with 93 days of history (I haven't deleted anything). That is a daily snapshot of my /etc, important dotfiles, and game saves. I haven't needed it yet, but I'm sure I will be glad when I do. EDIT: I just have a simple script in my cron.daily that backs up files and folders that I tell it to.
- caf 13y agoTARGETS="/etc /home /var /root /srv" ARCHIVE="$(hostname)_$(date +%Y-%m-%d_%H%M)" tarsnap -v -c -f "$ARCHIVE" $TARGETS
- pronoiac 13y agoUgh. This works, but it's ugly. There are a lot of automated tarsnap assistants on github; I made one myself.[1] They can do helpful things like allow for daily, weekly, and monthly backups, keeping a certain number of each. (And personally I like giving each folder its own archive, and I dislike having slashes in the archive names.) [1] https://github.com/pronoiac/tarsnap-cron https://github.com/pronoiac/tarsnap-cron - which might be helpful to someone else. It splits up the archiving and the pruning of old archives, so you can do those with different keys. This part is as yet untested. It probably requires an tarsnap fsck if you do those on different systems. I was going to forgo the plug, but it might be helpful, and I'm about to get some sleep, so I'll probably miss the best time to contribute to the discussion.
- 13y ago
- sillysaurus3 13y agoI have a question for Colin. What's the second-most-critical bug Tarsnap has ever experienced? Just curious.
- cperciva 13y agoThere was a bug in Tarsnap 1.0.20 (February 2009) which had a ~ 0.2% chance of causing silent data corruption if people were using the new --checkpoint-bytes option. (The bug actually had two possible consequences, silent data corruption and exiting with an error, and my analysis showed that the second was about 500x more likely to occur first.) Fortunately this was a new feature and I was able to identify which people had used it (since it relies on server-side functionality and I had good logs) so I could email all the potentially-affected users to warn them.
- lawnchair_larry 13y agoWhat was the cause?
- cperciva 13y agoUhh... let me look back at that code. My memory isn't what it used to be... right, now I remember. Sort of. So, Tarsnap uses a "chunkification cache" to speed up archiving; when it chews through a file and splits it into chunks, it records "file X was N bytes, had inode #I, and was last modified at time T, and here's the chunks it was split into". The next time it sees the file, it starts by stat()ing the file and if those parameters match it reuses the chunk list rather than reading the file from disk and splitting it into chunks again. With checkpointing enabled, if a checkpoint occurred in the middle of a file a truncated entry (to be specific, the chunk list for the portion of the file which had been processed) would be stored in the chunkification cache. If a later tarsnap process read that it was possible that it would archive the file wrong (I think it would be truncated, but I'm not absolutely certain right now). The fix was simply to not use an entry from the chunkification cache if it wasn't internally consistent.
- _delirium 13y agoI don't have much insight into what's profit-maximizing in this market, but rather than "public utility pricing" (though I can also see that analogy) I think of it as more like classic small-business pricing, especially in markets where developing some kind of reputation for fairness is deemed important by the owner. I can't think of a good representative example, but it's so well established I'm pretty sure I've run across examples in 19th-century American novels of this sort of "fair price with a modest profit" ethos.
- cperciva 13y agodeveloping some kind of reputation for fairness is deemed important by the owner That's certainly part of it. Let's face it, a lot of people use Tarsnap because of my reputation; I'd like to have Tarsnap contribute to my reputation rather than merely taking advantage of it. I'm pretty sure I've run across examples in 19th-century American novels of this sort of "fair price with a modest profit" ethos. I guess I really am a bit anachronistic...
- wglb 13y agocperciva hopes, by strict attention to business, combined with moderate charges, to merit a fair share of patronage and support. (stolen from tom)
- johnchristopher 13y ago> This will no doubt annoy my friends Patrick McKenzie and Thomas Ptacek, who for years have been telling me that I should raise Tarsnap's prices. But while Thomas accuses me of running Tarsnap like a public utility rather than a business, and thinks this is a characteristic to be avoided, I see this as a high compliment (...) That's really nice. I'd rather have fair public utility rather than business for the sake of concentrating money. I won't think twice about it the day I need to sign-up for tarsnap. That is
- davidw 13y agoI wonder how sustainable it is though. cperciva could make a boatload of money doing something else for someone else. Right now maybe that's not an attractive option, but perhaps at some point he'll, say, marry, have kids, and want some more cash and financial security.
- cperciva 13y agoI did say that I'm paying myself what I consider to be a reasonable salary. perhaps at some point he'll, say, marry, have kids, and want some more cash and financial security. I am currently single, but if/when I find the right girl I don't expect finances to be the limiting factor.
- davidw 13y agoCould you replace yourself in the business for what you're paying yourself?
- cperciva 13y agoSubject to the usual caveats about no person ever being a perfect replacement for another person: Yes.
- pedrocr 13y agoSo to a first approximation you're valuing the business at 0. You're generating enough free cash flow to pay the salary needed to keep it running but no more. If you wanted to delegate that responsibility you, as the owner, couldn't get anything out of the business as the free cash flow would be 0. Nothing wrong with that really, but if you really want to strictly price it as a utility there needs to be some form of return on equity. Even amazon generates some free cash flow, they've just been reinvesting it all so not generating any income.
- crdoconnor 13y agoIt's still a fair bit from being the cheapest UNIX backup (that also does client side encryption). Crashplan, Spideroak and Wuala (for 100GB and under) are a bit cheaper ( http://skeptu.com/tarsnap/100gb http://skeptu.com/tarsnap/100gb ). It has a nice CLI, however.
- venomsnake 13y agoBut does crashplan does client side decryption? That is the one weak spot in my current backup provider - backblaze. They encrypt and protect your data and when you need to restore it is out in the wild.
- pedrocr 13y agoWhy not just run encfs or ecryptfs locally and then backup the encrypted regular files?
- computer 13y agoOr use duplicity. It even directly supports many cloud-services as backend, including Google Drive ($2 for 100GB, $10 for 1TB) Dropbox, Onedrive, etc. It encrypts, deduplicates, stores old versions, etc.
- 8_hours_ago 13y agoI'd love to use duplicity, but in the 3rd paragraph of their website is the sentence "Duplicity is still in Beta.". I'd much rather trust my backups to tarsnap, which is not in beta. Furthermore, and perhaps even more importantly, tarsnap offers support which duplicity does not. When my hard drives decide to die, I really want someone who I can contact if there are any issues restoring from backups.
- chuckup 13y agoCheck out Duplicati - same idea as duplicity, but in active development, main developer posts to his support group frequently, overall very solid
- jrnkntl 13y agoQuestion about Tarsnap backup strategies and worst case scenarios. How would one go about making sure that when a server is compromised, the malicious attacker wouldn't be able to delete all the tarsnap archives for that machine? Since the tarsnap.key is stored on the server itself and that's all you need to delete archives as well. Of course, you're already properly effed when an attacker has root access to the machine, but offsite backups should still be safe imho. That's why on some of my servers I have a 'pull'-backup strategy in place, where a remote server would connect to the machine to be backupped and pull a backup, so in an event of that the server would be compromised no backups could be deleted. Is this something that can be achieved with Tarsnap as well?
- luuse 13y agoMay be a bit OT but is there any way to create an archive locally and see the size of it before paying to figure out how much space i'd need? Been looking at tarsnap for a while but never gotten around to actually try it and my quick naive calculations for backing up my ~ makes it sound too expensive for me even though it's probably the best alternative i've seen so far.
- cju 13y agoUsing options --dry-run and --print-stats would probably give you this information ''Don't really create an archive; just simulate doing so. The list of paths added to an archive (if the -v option is used) and statistics printed (if the --print-stats option is used) will be identical to if tarsnap is run without the --dry-run option.'' (http://www.tarsnap.com/man-tarsnap.1.html http://www.tarsnap.com/man-tarsnap.1.html)
- luuse 13y agoMissed the dry-run option but it still seems to require a key which requires you to pay. Talked with some on irc and it seems it's not possible at the moment. Someone mentioned gzip providing a good enough estimate on the compression without taking the de-duplication into account.
- keeperofdakeys 13y agoGzip would provide a fine-enough approximation, since both that and tarsnap use zlib. Tarsnap also has deduplication, so equal (or almost-equal) files will take up much less space.
- bosie 13y agois there a way to check the size of your backup without having an account?
- atmosx 13y agoThanks for that, using 'tarsnap' on a FreeBSD and a couple of RPi clients, works great! Always nice to get a price cut! PS. Is there any future plans to make restore a little bit faster? It's been a while since I restored some files, but the process was so slow that I thought there was a connection problem, then I googled and found out that it's okay to be slow :-)
- cperciva 13y agoImproving extract performance is my big project right now.
- samwillis 13y agoThe one thing that has put me off Tarsnap until now is, and not to be intentionally morbid, the bus factor [1] of 1. As far as I know its just Colin that runs it. In the unlikely event we need to access our backups, tarsnap is down and Colin is no longer available to maintain it we could be stuffed. Colin, do you have a contingency plan in place if you are not available? 1: http://en.wikipedia.org/wiki/Bus_factor http://en.wikipedia.org/wiki/Bus_factor
- read 13y agoWhat has put me off Tarsnap was not realizing that the price per GB is for compressed storage. So while it looks high compared to Amazon's per GB pricing, it's a lot cheaper. I don't recall if this was on Tarsnap's website when I had first checked, but it might be worth reporting the average compression rate to make more visible to prospective customers what the Amazon S3 storage portion of the pricing is.
- pedrocr 13y agoI'd assume the average compression rate to be very low, no? Don't modern cryptosystems have to encrypt then compress to avoid some forms of attack, thus making the compression not very effective?
- switch007 13y agoI love tarsnap. Thank you Colin! :) $ tarsnap --print-stats Total size Compressed size All archives 535 GB 233 GB (unique data) 1.2 GB 438 MB
- blankverse 13y agoWhat is "unique data"? Does it do de-duplication across users? Are you paying only for unique compressed data?
- Cederfjard 13y agohttp://www.tarsnap.com/faq.html#DEDUPE http://www.tarsnap.com/faq.html#DEDUPE Deduplication across users isn't possible due to encryption, but it is done locally on your own data, so it is true that you only pay for unique and compressed data.
- midas007 13y agoTarsnap is excellent for mission-critical data. But for most personal uses, a Glacier-backed variant of tarsnap would be extremely appealing.
- fhars 13y agoYou really want something that is orders of magnitude slower and several times as expensive? http://www.daemonology.net/blog/2012-09-04-why-tarsnap-doesnt-use-glacier.html http://www.daemonology.net/blog/2012-09-04-why-tarsnap-doesn...
- hamburglar 13y agoI would personally be totally fine with a backup solution which is orders of magnitude slower and several times as expensive in the rare restore case if it meant that the typical "write only for long periods of time" scenario was significantly cheaper. My personal backups are not something I'd ever need to restore in a hurry. The one big downside to the "cheap backup, expensive restore" approach is that it discourages testing your restore.
- akkartik 13y agoEven excluding all the details of tarsnap's design, using glacier for backups has always seemed totally wrong-headed to me for a simple reason: it disincentivizes checking up on your backups, which is a key part of doing backups. No point waiting until you lose your data to realize that your backups had developed a glitch. Add any minimal restoring cost and glacier costs about the same as regular storage -- with a lot less convenience. I honestly can't think of a use case for something like glacier, where storage is cheap but reading/writing is expensive.
- mrfusion 13y agoWould tarsnap do well to become a non-profit? He could still pay himself a fair salary but he'd avoid any tax liability for the business and I guess he could accept donations too? I don't know much about it, but if your only goal is a fair salary I've always assumed a non profit business structure would make sense? Can someone more knowledgable chime in?
- eli 13y agoErr, well not if your goal is to make a profit.
- mrfusion 13y agoRight but in his post he states that his goal is to make a fair salary. Non profits allow you to pay yourself a fair salary AFAIK.
- keeperofdakeys 13y agoThere's no real reason to turn Tarsnap into a non-profit. At least for now, the work is easily handled by him, he still has a passion for the work, and the project isn't large enough to require any "management".
- gphilip 13y agoIf I wanted to store, say, a 100 GB of photographs (jpeg and raw formats), roughly how much would it cost me per month just for the storage? Let's say I would upload one big archive of photos in the beginning, and then re-archive the photo collection whenever I add significantly more photos to the collection (after a vacation or a birthday). To go just by the stated pricing of Tarsnap, this would cost me $25 per month for the storage. But then I also see mention of users with terabytes worth of archives who pay less than $10 a month. I read the FAQ entry which explains how this happens, but that does not really tell me whether I can hope for such savings when it comes to photos. Do photo collections (raw/jpeg/both) "shrink" significantly from the deduplication and compression of Tarsnap? I think they don't (and that the savings apply to incremental backups), but it would be great if you could make this clear. Thank you!
- irv 13y agoi did an experiment where my raw & converted jpegs ended up compressed by about 12% overall, if that's any help.
- kapsel 13y agoTarsnap won't be able to shrink your photos by using deduplication and/or compression. I guess users paying 10$/mo with terabytes of data stored, have massive advantages of both, but it all depends on your usage. If you are going to store 100GB of photos with Tarsnap, I'd guess it would be close to 25$ as you said. If you just want your photo collection for disaster recovery, you could check out Glacier instead, which is a lot cheaper.
- jmathai 13y agoI'll start with my disclaimer that I'm founder of Trovebox and this isn't a sales pitch because we've focused Trovebox for business use. Great, that's out of the way. Storing and archiving photos & videos is near and dear to my heart [1] and I believe that cloud storage is one piece of answering yes to the question of "will I have my photos in 50 years?". My entire Shuttleworth Fellowship is based on this. Here's my $.02. Cost - we haven't yet but have all the pieces to use Amazon Glacier for storage of high resolution originals. That means storing 100 GB will cost you $1 / month. There's additional costs to keep thumbnails in S3 for immediate access -- my estimate is <$3 all inclusive for that 100GB. Ownership / Portability - a big part of my fellowship is to see how a hosted service (ala Flickr) can provide 100% ownership and portability. The solution is to let users (optionally) bring their own storage. So you can use the Trovebox software connected to your own Glacier and S3 bucket. Functionality - I think organization, viewing, sharing and archiving should be merged together. Instead of having your sharable photos in one place and your archives in another --- why aren't they combined? Raw - we support RAW and do conversion to JPEG. Open Source - Check [2]. Mobile - Check [3] [4] [5] [6]. API - Check [7]. [1] http://www.shuttleworthfoundation.org/fellows/current/jaisen-mathai/ http://www.shuttleworthfoundation.org/fellows/current/jaisen... [2] https://github.com/photo https://github.com/photo [3] https://github.com/photo/mobile-ios https://github.com/photo/mobile-ios [4] https://github.com/photo/mobile-android https://github.com/photo/mobile-android [5] https://itunes.apple.com/us/app/trovebox/id511845345?mt=8 https://itunes.apple.com/us/app/trovebox/id511845345?mt=8 [6] https://play.google.com/store/apps/details?id=com.trovebox.android.app https://play.google.com/store/apps/details?id=com.trovebox.a... [7] https://trovebox.com/documentation https://trovebox.com/documentation
- thomasfl 13y agoDoes anyone know if heroku will cut their prices after the amazon aws price cut?
- dewey 13y agoI'm using tarsnap in combination with https://github.com/Gestas/Tarsnap-generations https://github.com/Gestas/Tarsnap-generations for rolling backups. Are there any better tools out there to schedule backups and purge old backups? I'd be happy with a simple tool which just keeps 7 daily backups and that's it.