5 ms·

I think you want rclone. Specifically a combination of: a local filesystem remote a cloud provider remote rclone serve s3 to serve a local s3 compatible API

by haiku2077 1y ago

I think you want rclone. Specifically a combination of: a local filesystem remote a cloud provider remote rclone serve s3 to serve a local s3 compatible API for the local remote something orchestating an rclone copy, rclone sync or rclone bisync command to sync the local and cloud remotes. Could be triggered on a timer, or using another tool to watch the local directory for changes and trigger a sync.

aspenmayer 1y ago
I swear I suggested rclone on an old refresh of the page only to find you had posted this nearly an hour ago. I wasn't sure rclone could fit this use case, but I'm glad I wasn't totally off-base in assuming it was very close. I think you can run rclone as a service, they recommend you use bisync on crontab, for example. What's bisync? I don't really know, as it's new to me, but it's an experimental beta feature from rclone and sounds neat. https://rclone.org/bisync/ https://rclone.org/bisync/ https://rclone.org/bisync/#sharing-an-encrypted-folder-tree-between-hosts https://rclone.org/bisync/#sharing-an-encrypted-folder-tree-... > Sharing an encrypted folder tree between hosts > bisync can keep a local folder in sync with a cloud service, but what if you have some highly sensitive files to be synched? > Usage of a cloud service is for exchanging both routine and sensitive personal files between one's home network, one's personal notebook when on the road, and with one's work computer. The routine data is not sensitive. For the sensitive data, configure an rclone crypt remote to point to a subdirectory within the local disk tree that is bisync'd to Dropbox, and then set up an bisync for this local crypt directory to a directory outside of the main sync tree.
- haiku2077 1y ago
  Yeah for my home server backups I run rclone on a systemd timer
- remram 1y ago
  > https://rclone.org/bisync/ https://rclone.org/bisync/ This is quite an amazing man page, at no point does it say what the command does. It has a lot of details upfront about it being beta, and where its working directory is, and what the limitations are. But what does it do?
  - aspenmayer 1y ago
    Bidirectional sync via rclone?
  - haiku2077 1y ago
    That's not the manpage, this is the manpage: https://rclone.org/commands/rclone_bisync/ https://rclone.org/commands/rclone_bisync/

aspenmayer 1y ago

I swear I suggested rclone on an old refresh of the page only to find you had posted this nearly an hour ago. I wasn't sure rclone could fit this use case, but I'm glad I wasn't totally off-base in assuming it was very close. I think you can run rclone as a service, they recommend you use bisync on crontab, for example. What's bisync? I don't really know, as it's new to me, but it's an experimental beta feature from rclone and sounds neat. https://rclone.org/bisync/ https://rclone.org/bisync/ https://rclone.org/bisync/#sharing-an-encrypted-folder-tree-between-hosts https://rclone.org/bisync/#sharing-an-encrypted-folder-tree-... > Sharing an encrypted folder tree between hosts > bisync can keep a local folder in sync with a cloud service, but what if you have some highly sensitive files to be synched? > Usage of a cloud service is for exchanging both routine and sensitive personal files between one's home network, one's personal notebook when on the road, and with one's work computer. The routine data is not sensitive. For the sensitive data, configure an rclone crypt remote to point to a subdirectory within the local disk tree that is bisync'd to Dropbox, and then set up an bisync for this local crypt directory to a directory outside of the main sync tree.

haiku2077 1y ago
Yeah for my home server backups I run rclone on a systemd timer
remram 1y ago
> https://rclone.org/bisync/ https://rclone.org/bisync/ This is quite an amazing man page, at no point does it say what the command does. It has a lot of details upfront about it being beta, and where its working directory is, and what the limitations are. But what does it do?
- aspenmayer 1y ago
  Bidirectional sync via rclone?
- haiku2077 1y ago
  That's not the manpage, this is the manpage: https://rclone.org/commands/rclone_bisync/ https://rclone.org/commands/rclone_bisync/