3 ms·
The question is quite open ended as to whether it means backup, or something else. I use IPFS. IPFS is great for sharing multi-gigabyte size files between mach
by ianopolous 9y ago
The question is quite open ended as to whether it means backup, or something else.
I use IPFS. IPFS is great for sharing multi-gigabyte size files between machines in a cluster, bit-torrent style. In my case it is a couple of hundred Amazon spot instances that can come and go very fast and need to get the data ASAP to start some calculation, the same data for all nodes.
- empath75 9y agoI am super interested in more details on this. Can you do a blog post?
- peterwwillis 9y agoWhat are you looking for that you wouldn't get from looking at the IPFS website, or just googling in general?
- empath75 9y agoThe details of using ipfs in production? It's very early beta software and I don't know of anybody using it for real work.
- ianopolous 9y agoThe only difference from standard ipfs usage is to keep the data private. To do that I use a private subnet to stop incoming connections, make sure the ipfs instances don't try and contact the real ipfs network, and use my own bootstrap ipfs node which is permanent.
- empath75 9y agoI was actually considering tying it into consul somehow so the nodes could discover each other.
- narrowrail 9y agoI think your interest makes sense considering the GGGGP post made claims of using IPFS in what seems like a usfeful setup w/o sharing the details.
- Something1234 9y agoI really want to know what you are working on, in that it can just be in the mist.
- ianopolous 9y agoMy background is particle physics and it is quite a common paradigm there. Many people, or indeed the same person, want to run many calculations over the same large dataset. The results clearly need to be posted somewhere and are generally much smaller than the input data, so this isn't a problem.
- nunez 9y agoI believe Uber uses IPFS if I'm not mistaken.