3 ms·

Would it go significantly quicker if you downloaded it to a VPS instead of your home?

• baldfat 11y ago
  That would help but the cost of storage for 11 TB and the up time to download would be extremely expensive. I haven't seen an option that works for less than around $200 to rent and setup.
  • a3n 11y ago
    $200 isn't all that much, if it lets you get results while you're still alive. :)
    • baldfat 11y ago
      Tell that to my wife :)
  • a3n 11y ago
    It seems like if these large public datasets continue to come on line, there will need to be some sort of semi-cooperative distributed data store to make them truly "accessible." Or the data provider will need to provide an access/query API, rather than just a big tank that you can copy if you dare.
    • baldfat 11y ago
      Bit Torrent might actually help as a tool to help distribute these large data sets. The big issue is that so few people actually would need to download these large dataset.
      • a3n 11y ago
        But possibly many more people could use access to the data while they use the apps that were made possible by the data.