3 ms·
> The challenge in moving large amounts of scientific data is that the open Internet is designed for transferring small amounts of data, like web pages Isn't t
by grondilu 11y ago
> The challenge in moving large amounts of scientific data is that the open Internet is designed for transferring small amounts of data, like web pages
Isn't there FTP for large data transfers?
- stephengillie 11y agoI'm sure the File Transfer Protocol can handle 20 petabyte file transfers. They're probably in 200GB tarballs or something most file systems can work with. But even if you have 1 gigabyte per second upload and download, you might not want to wait the 2 years for the file transfer.
- craigjb 11y agoThere is a whole group of tools for transfers when your data is big: http://moo.nac.uci.edu/~hjm/HOWTO_move_data.html http://moo.nac.uci.edu/~hjm/HOWTO_move_data.html