3 ms·
Basically you want S3, which has BitTorrent BTW. S3 has multiple widely used command line tools that support syncing (cloning, pushing). There are multiple heav
by antoncohen 9y ago
Basically you want S3, which has BitTorrent BTW. S3 has multiple widely used command line tools that support syncing (cloning, pushing). There are multiple heavily used S3-like systems, open and closed source, some are S3 API compatible. Examples include Ceph and OpenStack Swift.
The reason people use cloud services instead of running these themselves is because the cloud storage fee is usually less than paying someone to run a distributed system.
- chubot 9y agoRight, but I can run my own git "server" with no problem. That's why I use that analogy. Plenty of people run their own BitTorrent trackers too. In my mind, "cloud" open source means: you need a team of experts to run it. git and BitTorrent are different -- they are designed for you to run it yourself. Also, the model is to "sync" and then "read/write", as with git (and BitTorrent). Not just read/write remotely. So maybe I should call it a "replicated file system" rather than a distributed one. I guess the main difference with git is that it should handle large binaries / many files, you shouldn't have to clone the entire repo, and maybe users/permissions.
- stephenr 9y agoIts not a solution to all problems but Minio (https://minio.io https://minio.io) will provide s3 compatible data storage on your own server(s).