5 ms·

... if it's not clear, the enabling technology here is the wonderful rclone[1] tool which rsync.net has built into the platform. So, in the same way that you c

by rsync 6y ago

... if it's not clear, the enabling technology here is the wonderful rclone[1] tool which rsync.net has built into the platform. So, in the same way that you can run 'git' commands over SSH: ssh user@rsync.net "git clone git://github.com/freebsd/freebsd.git freebsd" ... you can now, also, run 'rclone' over SSH: ssh user@rsync.net rclone s3:/some/bucket gdrive:/blah [1] https://rclone.org/ https://rclone.org/

gregsadetsky 6y ago
rclone is such an incredible program. Rock stable, compatible with so many services... Thanks a lot for making it part of rsync.net! (I'm a recent customer of yours and am very happy about everything)
thebankfarter 6y ago
Thanks for letting us know. I'm a client of yours and I'm happy with the service. Aside: Ever consider making some portion of the storage available for sharing. I often take screenshots/share documents with my teams and use a program that can use SFTP. Great work.
- rsync 6y ago
  Well, one bedrock design consideration at rsync.net is that there will never be an HTTP server on our systems - the storage is accessible by SSH only.[1] Surely that limits our product fit and reduces our growth BUT what it does for security and attack surface is priceless. However, the idea that you might have a fixed subdirectory in your rsync.net account - with a distinct password and login - is interesting and we should think about that. You're saying that would be useful even though it is accessible only by SFTP ?
  - thebankfarter 6y ago
    Here's a dialogue box from the program: https://dsh.re/14836 https://dsh.re/14836 Yes your suggestion would work. I'd be happy to connect to a subfolder with my SSH key or secondary SSH key. As it stands, I set up connections to other SSH servers with keys. It would definitely maintain your strict need to maintain security account security. Reach out to me if you want some more feedback: I'm Rsync.net user 59243
  - rakoo 6y ago
    Indeed not enabling HTTP access on rsync.net servers makes sense, because it opens up such a big can of worms. If users want to they can use something like filestash (https://www.filestash.app/ https://www.filestash.app/) that gives a drive-like access to storage placel that respect standards, such as SFTP. It's very easy to install on a cheap server and bridge to rsync.net without storing any secrets on that server
joeraut 6y ago
Happy rsync.net client here, thanks for the great service; the ability to use rclone for exactly this purpose, without having to worry about ingress/egress charges, is a huge value-add. Edit: Will free-of-charge ingress/egress always be a feature of the service? With more customers using rclone for shifting data to/from/between other services, I'd hypothesize that bandwidth use could be creeping up. Edit 2: A feature I'd love to see would be the ability to setup automated cron-like jobs directly from the admin portal, for e.g. automated rclone backups, eliminating the friction of having to setup another service to periodically run a command on rsync.net. (Tricky to do in a serverless fashion for long-running commands like rclone.) Is this something that might be in the pipeline?
- rsync 6y ago
  Yes, there is the potential of an rsync.net account being used as a "seedbox" - as the young people call it. However, even our discounted pricing is more expensive than the cutthroat seedbox provider pricing that we see out in the world - so I think serious folks will use rsync.net accounts for brokering data like this, but the datahoarder crowd will store their petabytes elsewhere. Also, we have recently turned up multiple 10gb pipes at he.net which we found to be very affordable in 2021 so, at least for now, we have bandwidth to spare ...
asadhaider 6y ago
It'd be great to have some more info on the page and examples maybe for people to understand it better as I couldn't figure out how to sync between providers until I saw this comment of yours. Fantastic product, always seen your posts on HN and signed up a few months ago with a 100GB plan. Been very happy :)

by rsync 6y ago

gregsadetsky 6y ago

rclone is such an incredible program. Rock stable, compatible with so many services... Thanks a lot for making it part of rsync.net! (I'm a recent customer of yours and am very happy about everything)

thebankfarter 6y ago

Thanks for letting us know. I'm a client of yours and I'm happy with the service. Aside: Ever consider making some portion of the storage available for sharing. I often take screenshots/share documents with my teams and use a program that can use SFTP. Great work.

rsync 6y ago
Well, one bedrock design consideration at rsync.net is that there will never be an HTTP server on our systems - the storage is accessible by SSH only.[1] Surely that limits our product fit and reduces our growth BUT what it does for security and attack surface is priceless. However, the idea that you might have a fixed subdirectory in your rsync.net account - with a distinct password and login - is interesting and we should think about that. You're saying that would be useful even though it is accessible only by SFTP ?
- thebankfarter 6y ago
  Here's a dialogue box from the program: https://dsh.re/14836 https://dsh.re/14836 Yes your suggestion would work. I'd be happy to connect to a subfolder with my SSH key or secondary SSH key. As it stands, I set up connections to other SSH servers with keys. It would definitely maintain your strict need to maintain security account security. Reach out to me if you want some more feedback: I'm Rsync.net user 59243
- rakoo 6y ago
  Indeed not enabling HTTP access on rsync.net servers makes sense, because it opens up such a big can of worms. If users want to they can use something like filestash (https://www.filestash.app/ https://www.filestash.app/) that gives a drive-like access to storage placel that respect standards, such as SFTP. It's very easy to install on a cheap server and bridge to rsync.net without storing any secrets on that server

joeraut 6y ago

Happy rsync.net client here, thanks for the great service; the ability to use rclone for exactly this purpose, without having to worry about ingress/egress charges, is a huge value-add. Edit: Will free-of-charge ingress/egress always be a feature of the service? With more customers using rclone for shifting data to/from/between other services, I'd hypothesize that bandwidth use could be creeping up. Edit 2: A feature I'd love to see would be the ability to setup automated cron-like jobs directly from the admin portal, for e.g. automated rclone backups, eliminating the friction of having to setup another service to periodically run a command on rsync.net. (Tricky to do in a serverless fashion for long-running commands like rclone.) Is this something that might be in the pipeline?

rsync 6y ago
Yes, there is the potential of an rsync.net account being used as a "seedbox" - as the young people call it. However, even our discounted pricing is more expensive than the cutthroat seedbox provider pricing that we see out in the world - so I think serious folks will use rsync.net accounts for brokering data like this, but the datahoarder crowd will store their petabytes elsewhere. Also, we have recently turned up multiple 10gb pipes at he.net which we found to be very affordable in 2021 so, at least for now, we have bandwidth to spare ...

asadhaider 6y ago

It'd be great to have some more info on the page and examples maybe for people to understand it better as I couldn't figure out how to sync between providers until I saw this comment of yours. Fantastic product, always seen your posts on HN and signed up a few months ago with a 100GB plan. Been very happy :)