7 ms·
Rclone syncs your files to cloud storage
- artdigital 3y agoRclone can also mount cloud storage to local disk, especially nice from kubernetes. Write/read speed isn't the fastest when using as a drive with lots of files in the same folder, but a quick and easy way to utilize cloud storage for projects It can also e2e encrypt locations, so everything you put into the mounted drive is getting written encrypted to Dropbox folder /foo, for example. Nice, because Dropbox and other providers like s3 don't have native e2e support yet All in all, Rclone is great! One of those tools that is good to have on hand, and solves so many usecases
- sgbeal 3y agoIt's also a trivial way to set up an ad-hoc ftp server which serves either local or cloud storage. e.g. my Pi4 runs an rclone ftp server which exposes my dropbox to the rest of my intranet, and a separate ftp server which my networked printer can save scans to. The same machine uses rclone to run automated backups of cloud storage for my household and a close friend. rclone is a godsend for my intranet.
- artdigital 3y agoOh wow I didn't know about this! Good tip
- bravura 3y agoDo you mind explaining why it's so trivial versus setting up traditional ftp? I'm missing something. Thank you
- killingtime74 3y agoCan traditional FTP talk to Dropbox?
- OkGoDoIt 3y agoAssuming the Dropbox is synchronized somewhere to your file system, the FTP server could serve that directory. Although I guess not everyone synchronizes their Dropbox locally.
- sgbeal 3y ago> Although I guess not everyone synchronizes their Dropbox locally. And i've yet to see a pi-native dropbox client for doing so. PS: i actually do sync dropbox to my main workstation but selectively do so. The lion's share of my dropbox is stuff i don't need locally so don't bother to sync it. The rclone approach gives me easy access to the whole dropbox, when needed, from anywhere in my intranet, and i can use my local file manager instead of the dropbox web interface.
- sgbeal 3y ago> Do you mind explaining why it's so trivial versus setting up traditional ftp? nohup /usr/bin/rclone serve ftp --addr MYIP:2121 $PWD &>/dev/null & No configuration needed (beyond rclone's per-cloud-storage-account config (noting that serving local dirs this way does not require any cloud storage config)) and some variation of that can be added to crontab like: @reboot /usr/bin/sleep 30 && ...the above command... Noting that $PWD can be a cloud drive identifier (part of the rclone config) so it can proxy a remote cloud service this same way. So, for example: rclone serve ftp --addr MYIP:2121 mydropbox: assuming "mydropbox" is the locally-configured name for your rclone dropbox connection, that will serve your whole dropbox.
- steve_rambo 3y agoJust write a systemd unit. These commands are not any easier to support and are far worse from the purely technical point of view. You'll get: - startup only when the network is up - proper logging - automatic restarts on failure - optional protection for your ssh keys and other data if there's a breach (refer to `systemd-analyze security`) Run: $ systemctl --user edit --full --force rclone-ftp.service this opens a text editor; paste these lines: [Unit] After=network-online.target Wants=network-online.target [Install] WantedBy=default.target [Service] ExecStart=/usr/bin/rclone --your-flags /directory and then enable and start the service: $ systemctl --user enable --now rclone-ftp
- rezonant 3y agoSeriously yes. Crontab isn't meant to keep your services up. We have a proper service manager now, out with the hacks.
- lillecarl 3y agoPeople go out of their way to build their own crappy version of systemd. systemd is far from perfect, and Poettering is radically anti-user. But it's the best we got and it serves us well
- frankjr 3y ago
- rakoo 3y agoAnd then all you need to do is use a trivial curlftpfs to have a synchronized folder available. Dropbox is not needed anymore ?
- FwarkALark 3y ago> Rclone can also mount cloud storage to local disk It's not immediately apparent what this means—does it use FUSE, 9p, a driver, or some other mechanism to convert FS calls into API calls? EDIT: it's FUSE.
- safety1st 3y agoHas anyone used it successfully as a replacement for two-way sync apps (like Insync for Google Drive)?. Insync sucks, and Google Drive sucks, but for something I depend on every day I feel like I really need to have a local copy of the files and immediate sync between local and server, particularly when Internet access is spotty.
- godzillabrennus 3y agoSeems like a market opportunity exists for this especially with Apple cutting external drive support for third party sync tools including DropBox.
- CharlesW 3y agoYou can still do this, but Dropbox can’t use the File Provider API for that yet, so the experience won’t be quite as integrated as it is with Dropbox for macOS on File Provider. See https://help.dropbox.com/installs/dropbox-for-macos-support https://help.dropbox.com/installs/dropbox-for-macos-support for more.
- sgbeal 3y ago> Insync sucks... FWIW, i've been using Insync on Linux since it went online (because Google never released a Linux-native client). Aside from one massive screw-up on their part about 8 or 10 years ago (where they automatically converted all of my 100+ gdocs-format files to MS office and deleted the originals), i've not had any issues with them. (In that one particular case the deleted gdocs were all in the trash bin, so could be recovered. Nothing was lost, it was just a huge pain in the butt.)
- tomcam 3y ago> Aside from one massive screw-up on their part about 8 or 10 years ago (where they automatically converted all of my 100+ gdocs-format files to MS office and deleted the originals) Why. Just why. How does that shit ever happen in a public release?
- 3y ago
- xcrunner529 3y agoI first used it at work to sync a OneDrive folder from a shared drive due to different audiences. Very cool tool. The open source stuff I really love.
- akdev1l 3y agoWhen you say “e2e” encryption do you mean client-side encryption? Because S3 supports both client and server side encryption. (It doesn’t really need to do anything on the service side to support client-side encryption tbf) For client side encryption they have a whole encrypted S3 client and everything. (https://docs.aws.amazon.com/amazon-s3-encryption-client/latest/developerguide/what-is-s3-encryption-client.html https://docs.aws.amazon.com/amazon-s3-encryption-client/late...)
- aborsy 3y agoThis seems to be an SDK or library, not a command line tool.
- ddeck 3y agoIt is indeed great for this, but you need to make sure your network is stable. I use it on my desktop and laptop to mount Google drives. The problem on the laptop is that the OS sees the drive as local, and Rclone doesn't timeout on network errors. So if you are not connected to wifi and an application tries to read/write to the drive, it will hang forever. This results in most of the UI locking up under XFCE for example, if you have a Thunar window open.
- stiff 3y agoThere is in fact a default timeout of 5 minutes and you can change it: https://rclone.org/docs/#timeout-time https://rclone.org/docs/#timeout-time I shorten it to prevent lockups like you are describing.
- ddeck 3y agoThanks, but unfortunately this doesn't work - for my issues at least. I have this (and conntimeout) set to 15 seconds, but it makes no difference. I tried those based on another user reporting the same issue here: https://forum.rclone.org/t/how-to-get-rclone-mount-to-issue-an-i-o-timeout-after-a-remote-becomes-unavaliable/24220 https://forum.rclone.org/t/how-to-get-rclone-mount-to-issue-... The timeout param is listed as "If a transfer has started but then becomes idle for this long it is considered broken and disconnected". This seems to be only for file transfers in progress. I traced it once, and Rclone gets a "temporary DNS failure" error once the network is down, but just keeps retrying.
- joshspankit 3y agoSounds like you have enough for a decent bug report
- jmaker 3y agoSimilar issues with WebDAV mounts on macOS
- djbusby 3y agoI use rclone daily. It's replaced sshfs for some cases. Another is to push home server $Archive share to rsync.net. another is to pull photos into $Archive from my Google account, my wife's, moms, dads, and kids account. Also my 3 clound account for different $WORK into $Archive (and then to rsync.net). This is top-tier tooling right here.
- hyperpl 3y ago> another is to pull photos into $Archive from my Google account I assume you are pulling from Google photos? If so, then I think the only way to get original quality is to use takeout?
- djbusby 3y agoThis I'm not sure of. I also have a habit to use Takeout quarterly (but this blob is not merged). I think I should check these configs; I want the full fidelity.
- yunohn 3y agoSadly, it’s not configurable. It’s just an inherent limitation of the API (1). Takeout is the best alternative, but for something more realtime you can use tools (2) that wrap the browser UI which also exports full quality. (1) https://github.com/gilesknap/gphotos-sync#warning-google-api-issues https://github.com/gilesknap/gphotos-sync#warning-google-api... (2) https://github.com/JakeWharton/docker-gphotos-sync https://github.com/JakeWharton/docker-gphotos-sync
- progbits 3y agoRunning headless chrome and scraping the photos via dev tools sounds like good way to get your account banned by some automation with no human support to help you :/ It's really stupid that the API doesn't support this. For now I'll stick to regular takeout archives. Syncthing directly from the phone might be a better option for regular backups.
- 3y ago
- more_corn 3y agoI use this to replace rsync because it does some things significantly better.
- eek2121 3y agoSo I see this type of headline happen a lot, and despite being a long time reader and short time commenter, is there a reason the author doesn't make a more specific headline? Rclone has existed forever and has been mentioned here over a thousand times (https://www.google.com/search?client=firefox-b-1-d&q=rclone+site%3Anews.ycombinator.com https://www.google.com/search?client=firefox-b-1-d&q=rclone+...) Most of the time the poster links to a specific news item at least (which is also not okay without a specific headline) but sometimes the link just points to the home page. Regardless, it has been mentioned before. EDIT: Just to be clear, I'm not again an occasional mention of a project. Hacker news has allowed me to find some real gems, but most of those posts are new features added to the software, not just a generic link to the homepage.
- deleted 3y ago[deleted]
- pvg 3y agoReposts are fine after a year or so and there hasn't been one that recently. Titles are usually the titles of the pages linked as is this one. https://hn.algolia.com/?dateRange=all&page=0&prefix=true&query=by%3Adang%20%22new%20to%20you%22&sort=byDate&type=comment https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...
- iJohnDoe 3y agoI think it’s meant to generate upvotes on the post and also meant to encourage discussions. Like you mentioned, some real gems are found, and for me are often found in the comments. So, these reposts are helpful. It’s like how many posts were made for “What do you use for note taking?” Some gems are are in the comments.
- mil22 3y ago.
- pvg 3y agoIf it isn't newsworthy, why is it on Hacker News? This is discussed in the site docs, it's fine to get news from HN but HN is not really about news.
- _giorgio_ 3y agoWhat cloud storage provider officially supports this tool or the protocol used by it? The instructions look mostly like a reverse engineering effort that can fail anytime for any reason. Of course you'll get some notification, but still seems a thing to avoid in principle.
- password4321 3y agorsync.net
- andersa 3y agoMost providers support S3 compatible APIs which rclone can then use to talk to them. For example, S3, Cloudflare R2, Backblaze, ...
- mthoms 3y agoI've been using it with Vultr as well without a hitch.
- ordersofmag 3y agoIt's a wrapper around a bunch of API's. If that makes you nervous then wait until you hear about how the rest of the modern web is strung together. It's been working reliably for me for a decade.
- dannyw 3y agoThey generally use official APIs, of which most backends have. I’ve been using rclone for 3 years without issues. Across many different backends.
- FwarkALark 3y ago> What cloud storage provider officially supports this tool or the protocol used by it? Man I wish I lived in a universe where providers actually supported tooling. You're completely delusional tho.
- djbusby 3y ago
- geerlingguy 3y agoEvery time I see this pop up on HN, I upvote. I've been using rclone for years for my main backup [1] (now over 18 TB) from my home NAS to Amazon S3 Glacier-backed Deep Archive, and it is by far the easiest backup setup I've ever had (and cheap—like $16/month). [1] https://github.com/geerlingguy/my-backup-plan https://github.com/geerlingguy/my-backup-plan
- nektro 3y agoyou might be interested in https://restic.net https://restic.net :)
- A1kmm 3y agoThe two work together well too - I prefer to let Restic back up to a separate local (magnetic) HDD for my repo, and then use rclone to sync the local repo to Backblaze B2. Compared to a direct cloud repo set up in Restic, it gives me much better restore times and lower costs for the common case where your local site is not completely destroyed (e.g. data corruption etc...), while still giving you the safety of a slower and more expensive off-site backup for when you really need it.
- dchftcs 3y agoEgress costs are significant by the time you want to use your backup, around $1800 to download the 18TB, which is around 10 years of storage cost. If you assume 5 years of HDD data lifetime, you need to roughly triple that monthly cost, which is not too bad, but you can buy an enterprise 20TB drive per year for that cost. Personally I would only use AWS in a way that I would almost never have to pay for egress for the entire dataset except when my house gets burned, as a last-resort backup instead of a main one.
- geerlingguy 3y agoThat's exactly what I'm using it for :) I have a primary and backup NAS at home, and a separate archive copy updated weekly offsite locally. Then Glacier is my "there was a nuclear bomb and my entire city is completely gone" solution. And in that case, assuming I had survived, I would be willing to pay most anything to get my data back.
- ggm 3y ago[flagged]
- deleted 3y ago[deleted]
- crazygringo 3y agoSays that Apple doesn't provide a public web API for it. There's a ticket covering everything you might ever want to know: https://github.com/rclone/rclone/issues/1778 https://github.com/rclone/rclone/issues/1778 Seems like rclone would support it if Apple ever created an official way to do so.
- neilv 3y agoI used `rclone` in one startup to add the storage services the biz people were using, to engineering's easy&inexpensive offline "catastrophic" backups. I used the normal ways of accessing AWS, GitLab, etc., but `rclone` made it easy to access the less-technical services.
- divbzero 3y agoRclone has a large selection of storage backends [1] plus a crypt backend [2] for encrypting any of the storage backends. [1]: https://rclone.org/overview/ https://rclone.org/overview/ [2]: https://rclone.org/crypt/ https://rclone.org/crypt/
- miki123211 3y agoI'm definitely a Rclone fan, it's an invaluable tool if less technical folks give you lots of data in a consumer / business cloud, and you need to somehow put that data onto a server to do further processing. It's also great for direct cloud-to-cloud transfers if you have lots of data and a crappy home connection. Put clone on a server with good networking, run it under tmux, and your computer doesn't even have be on for the thing to run.
- sgbeal 3y ago> Put clone on a server with good networking, run it under tmux tmux isn't strictly necessary: nohup /usr/bin/rclone ... &>/dev/null & then log out and it'll keep running.
- miki123211 3y agoThat way doesn't let you check on your progress, right? Screen / Tmux let you re-attach to the session at any time and see what's going on, if there were errors etc.
- sgbeal 3y ago> That way doesn't let you check on your progress, right It does if you redirect the output to a file other than /dev/null, but in my experience checking on the progress is irrelevant - it's done when it's done.
- tomrod 3y agoI literally picked up rclone for the first time last weekend and have been running with it. Great tool!
- qudat 3y agorclone is so cool! https://pgs.sh https://pgs.sh is using similar tech but focusing on a managed service specifically for static sites.
- krick 3y agoJust browsing the list of supported providers and such makes me a bit overwhelmed. There are so many tools that are kinda similar but slightly different, that from "wow, rclone seems like a great tool" I quickly come to "what should I even use?" Rclone, restic, borg, git-annex… Is there a case to use several of them together? Are there, like, good comprehensive real-life case studies to see how people use all that stuff and organize vast amounts of data (which are kinda prerequisite for anything like that to be used in the first place)?
- deleted 3y ago[deleted]
- Shakahs 3y agoRclone is the general purpose "swiss army knife". It can be used to read/write/sync/copy/move files between any supported service and your local device, and also mount remote storage as a local drive. Restic and Borg are for making backups only.
- sgbeal 3y ago> It can be used to read/write/sync/copy/move To help avoid getting anyone's hopes up: rclone does not do automatic two-way sync. In rclone parlance, "sync" means to either pull all files from a remote and make a local copy match that, or do the opposite: push a local dir to a remote and update the remote to match the local one. Note that "match" means "delete anything in the target which is not in the source."
- CobrastanJorji 3y agoI appreciate how its home page proudly calls out that it always verifies checksums. I've been boggled in the past how many tools skip that step. Sure, it slows things down, but when you're syncing between cloud storage options, you're probably in a situation where you really, really want to verify your checksums.
- b33j0r 3y agoI thought the “indistinguishable from magic” testimonial at the top was a bit arrogant, but am currently trying to find out if these extraordinary claims have extraordinary evidence ;)
- patrickwalton 3y agoMy Dad left us 30 TB of data when he passed. I trimmed it down to 2 TB and tried to use Google's desktop sync app to upload it to cloud. It ran on my work computer during COVID for 8 months straight before finishing. When I tried to back up that and my other data to a hard drive, Google takeout consistently failed, downloading consistently failed. I went back and forth with support for months with no solution. Finally I found rclone and was done in a couple days.
- tomcam 3y ago> Google takeout consistently failed, downloading consistently failed I get extra angry about situations like this. I have paid Google many thousands of dollars over the years for their services. I just assume that one of the fundamentals of a company like that would be handling large files even if it’s for a fairly small percentage of customers. I get that their feature set is limited. I kind of get that they don’t provide much support. But for the many compromises I make with a company that size, I feel like semi-competent engineering should be one of the few benefits I get besides low price and high availability.
- firtoz 3y agoIn the past few years it has been a leech of brain power that's optimized itself into producing nothing of value except demos that get abandoned immediately. From what I read, they seem to have managers and executives with bad incentives and too much power. So it seems that it doesn't really matter how competent the engineer is, their work goes into numerous black holes in the end.
- harshreality 3y ago> We should also remember how a foolish and willful ignorance of the superpower of rewards caused Soviet communists to get their final result, as described by one employee: “They pretend to pay us, and we pretend to work.” Perhaps the most important rule in management is “Get the incentives right.” -- Charlie Munger, Poor Charlie's Almanack ch. 11, The Psychology of Human Misjudgment (principle #1)
- dmarinus 3y agoRclone is a magic tool, I've used it for many different use cases. When I last checked it doesn't use the AWS SDK (or the Go version is limited). Anyway, it isn't able to use all settings in .aws/config. But it is kind of understandable that it doesn't support all backend features because it's a multifunctional tool. Also the documentation is full of warnings of unmaintained features (like caching) and experimental features. Which is a fair warning but they don't specifically tell you the limitations.
- bobek 3y agoTake a look at Restic for backups. Rclone and Restic play together really nicely. https://www.bobek.cz/blog/2020/restic-rclone/ https://www.bobek.cz/blog/2020/restic-rclone/
- RockRobotRock 3y agoreally tough for me to decide to use restic or kopia. instead i use a way worse solution because i'm afraid i'll mess something up
- aborsy 3y agoI back up TBs with restic, never had issues. When I need a file, I mount the remote repository. The mount is fast with S3. The rclone backend means I can backup anywhere.
- hosteur 3y agoI use restic for everything Linux or windows except for Mac’s. There I use kopia. It just works. There is not much to mess up really. Just keep your password safe and be sure to test your backups.
- colonwqbang 3y agoLike with all contingency systems it's necessary to do a "fire drill" exercise from time to time. Pretend that you lost your data and attempt to recover a few files from backups. Pretend that your house burned down and you can't use any item from home. This will give you confidence that your system is working.
- archon810 3y agoCheck out duplicacy https://twitter.com/ArtemR/status/1159392251992145920 https://twitter.com/ArtemR/status/1159392251992145920 https://github.com/gilbertchen/duplicacy https://github.com/gilbertchen/duplicacy
- skrause 3y agoI moved away from Duplicacy to restic when restic finally implemented compression. Duplicacy is slower and also only free for personal use.
- RockRobotRock 3y agoup there with ffmpeg in terms of usefulness
- archon810 3y agorclone ncdu is my favorite rclone trick https://rclone.org/commands/rclone_ncdu/ https://rclone.org/commands/rclone_ncdu/. Most cloud space providers don't show you how much space each folder and subfolder actually occupies. Enter rclone ncdu.
- pcwelder 3y agorclone also has a "universal" file explorer. I haven't found any other such explorer.
- arcza 3y agoA shame the features don't indicate it can encrypt at rest.
- jkrubin 3y agoI have used rclone for several years now and it works so good. I use it in place of rsync often too. It’s great for file moving on local file systems too.
- conqrr 3y agoRestic (rclone)+ B2 + Systemd Has solved backups for my system. Mainly the home sir of my Linux desktop. Never looked at anything else.
- danboarder 3y agoThere is a built in web GUI (experimental), and I also found the RcloneBrowser project that looks helpful when a GUI is handy. https://kapitainsky.github.io/RcloneBrowser/ https://kapitainsky.github.io/RcloneBrowser/ https://github.com/rclone/rclone-webui-react https://github.com/rclone/rclone-webui-react
- haunter 3y agoLast commit 3 years ago
- haloboy777 3y agoI have been using rclone for over two years now. Typically, I run cron to copy any new files in the directories that are most important to me. The combination of rclone and B2 storage is quite effective, especially considering its ease of use and cost efficiency.
- kitd 3y agoThis is a great landing page IMHO. The first item is not some fancy graphic, but a short paragraph explaining exactly what it is. I had a vague idea about rclone already, but it took about 5 seconds of reading to get a good understanding about its capabilities and how it could help me. A much better sales pitch than having to fight through 'Get started' or Github links to find basic info.
- deleted 3y ago[deleted]
- tonymet 3y agoI use rclone on vm instances to sync files across gdrive, google photos , one drive , s3 and gcp object storage . Running migrations on the server side is faster and more reliable. I can monitor transforms and transfers in tmux and then run quality checks when it’s complete And having a vm lets me filter and transform the data during the migration. Eg pruning files , pruning git repos, compressing images . There’s a framework waiting to be made that’s like grub but for personal data warehouse grooming like this
- 1vuio0pswjnm7 3y ago[flagged]
- deleted 3y ago[deleted]
- zero0529 3y agoFun fact somebody reverse engineered the Proton Drive API by looking at their open source client and made a plug-in for RClone. This is currently the only way to get Proton Drive on Linux.
- simon1573 3y agoOh! I didn’t now there was support for Proton Drive in rclone. I’m on a Visionary plan since they re-opened that for a while so now I get the use the storage too. Thanks :)
- mike31fr 3y agoAn item on my todo list reads "Setup a backup system using Borg". I didn't know about Rclone but it seems very good, so now I want to rename my todo list item as "Setup a backup system using Rclone". How would you compare these 2 solutions?
- msanlop 3y agorclone is not a proper backup tool. It's like an rsync that integrates with all the clouds. You can kinda use it as one though. I had Borg in my todo for a long time too -- experimented with it and restic which are proper backup tools -- they are a little more involved than rclone (and scary, as they can get corrupted and you are essentially reliant on the software to get your files back). I found rclone much simpler to work with. As they always say, any backup is better than no backup! The simplest thing you can probably do is use rclone to copy your most important files to a B2 bucket. Enable Object-lock on the B2 bucket to ensure no deletion just to be safe. You can then run rclone on server and from your devices with cron jobs to archive your important stuff. This is not a proper backup as I said, if you rename files or delete unwanted stuff it wont leave on the backup bucket but it's usable for stuff like photos and the like, anything you don't want to lose. (I lied, simplest thing is actually probably just copying to an external hard drive, but I find having rclone cron jobs much more practical)
- mike31fr 3y agoThank you so much! It really helps. My data is on a Synology NAS. It seems B2 buckets support is built into the Hyper Backup Synology software (the one whose purpose it to perform backups), I'm not sure if I am going to chose that or Rclone. But I already found some resources (https://www.reddit.com/r/synology/comments/hsy29y/hyper_backup_vs_cloud_sync_vs_rclone/ https://www.reddit.com/r/synology/comments/hsy29y/hyper_back...), I'll investigate that. Do you, by chance, also perform your backups from a Synology NAS?
- Helmut10001 3y agoI am done with the cloud as a backup. I use ZFS incremental replication of Snapshots automated with Sanoid and Syncoid. To my own off-site box. So glad I don't have to mess with the file level again. Syncoid in pull-mode does not even need to know ZFS encryption keys (zero trust!).
- antongribok 3y agoIf you are only using those two tools, then you only have a system for replication (and snapshots), but not a backup system. If there is a data corruption bug in ZFS, it will propagate to your remote and corrupt data there. I hope you have something else in place besides those two tools.
- Helmut10001 3y agoYes (although ZFS is pretty stable, it is always good to mention to not put all your eggs in a single basket). My fallbacks are: - an external drive that I connect once a year and just rsync-dump everything - for important files, a separate box where I have borg/borgmatic [1] in deduplication mode installed; this is updated once in a while Just curious: Do you have any reason to believe that such a data corruption bug is likely in ZFS? It seems like saying that ext4 could have a bug and you should also store stuff on NTFS, just in case (which I think does not make sense..). [1]: https://github.com/borgmatic-collective/borgmatic https://github.com/borgmatic-collective/borgmatic
- Helmut10001 3y agoGood further comment on the subject [1]. [1]: https://www.reddit.com/r/zfs/comments/85aa7s/comment/dvw55u3/ https://www.reddit.com/r/zfs/comments/85aa7s/comment/dvw55u3...
- antongribok 3y agoIt's funny that you link to a comment from 6 years ago. Just a month after that there was a pretty big bug in ZFS that corrupted data. https://github.com/openzfs/zfs/issues/7401 https://github.com/openzfs/zfs/issues/7401 Corresponding HN discussion at the time: https://news.ycombinator.com/item?id=16797644 https://news.ycombinator.com/item?id=16797644
- stilley2 3y agoI gave up on the onedrive client and switched to rclone to access SharePoint at work. It's more manual but it always works! The onedrive client was great when it worked, but when it started misbehaving there was no real way to fix it besides reinstall and start over
- kevinsky 3y agoI have been using this for years with my cloud provider and this is a rock solid application. My only wish is that the logging could have a sweet spot in the middle where it is not verbose but does show the names of the files changed
- makerdiety 3y agoI don't use rsync. Because it's for synchronization and I don't really trust any of my storage drives to hold a perfect copy of data to sync from and act as an ultimate source of truth for connected, downloading clients. I especially don't really trust flash memory storage devices. The only source of truth that is really reliable is a password memorized in your brain. Because keyfiles that can decrypt data can be corrupted, that is to say, they rely on a secondary data integrity check. Like the information memorized in your brain.
- deleted 3y ago[deleted]
- JeremyNT 3y agoThis is really a great tool. You can also link against librclone if you need to use it as part of a larger application or do something more complex with it than scripting.
- apitman 3y agoLove rclone. IIRC for years the donation page said something along the lines of "rclone is a labor of love and I don't need your money, but if you'd like to help me buy my wife some flowers that would be greatly appreciated." Just seems like a cool dude. Glad to see he's able to do it full time now, and hope it's still as fulfilling. EDIT: Thanks to archive.org I found it[0]. Even more wholesome than I remembered: > Rclone is a pure open source for love-not-money project. However I’ve had requests for a donation page and coding rclone does take me away from something else I love - my wonderful wife. > So if you would like to send a donation, I will use it to buy flowers (and other pretty things) for her which will make her very happy. [0]: https://web.archive.org/web/20180624105005/https://rclone.org/donate/ https://web.archive.org/web/20180624105005/https://rclone.or...
- ossusermivami 3y agoNick is great i had a chance to meet him and he is indeed a great man!
- zipping1549 3y agoRclone solves so many problems for me it's crazy.
- ametrau 3y agoset it up a year ago. Running every day without an issue and not touching it for 365 days +
- leokennis 3y agoI’m a very occasional rclone user; I use it for one-off uploads of many files to some cloud, or syncing from cloud to cloud. Sometimes this is over shaky connections which can lead to many failures, so I love that you can just keep issuing the same sync command and it will continue from the point the sync broke.
- masto 3y agoI just discovered rclone last week. I have a nice multifunction color laser printer with a scanner, and I want to use it to scan to the cloud without having to use my computer, but it's one model before they introduced that feature. It only does FTP. Turns out rclone can present an FTP server proxy that is backed by any storage you want. I put it in a little Docker container and now I don't have to spend $400 on a new scanner.
- bofaGuy 3y agoI used Rclone at a major media company to move 4 PB of media files (so far) out of a legacy datacenter over a 200 GB link. I used 18 workers and we were able to saturate the link consistently. Good stuff.
- rldjbpin 3y agoi tried using it to encrypt my cloud backups, and it works great for desktop, even if it requires running commands. my gripe with it is to be able to use and sync from my smartphone. at least on ios, there is no robust tool that allows it afaik. there is cryptcloudviewer (https://github.com/lithium0003/ccViewer https://github.com/lithium0003/ccViewer) which has not been updated since 2020. appreciate any suggestions or more details of your workflow for these scenarios.