Very useful for storing medium/large-scale crawls. Common Crawl is 200TB+ per month (http://commoncrawl.org/connect/blog/ http://commoncrawl.org/connect/blog/).

Very useful for storing medium/large-scale crawls. Common Crawl is 200TB+ per month (http://commoncrawl.org/connect/blog/ http://commoncrawl.org/connect/blog/). Uncompressed, if compressed it'd probably go through one such disk every 1-2 months. My own crawling operations consume about half a TB each month. Storing high resolution (1080p/4K) videos is another big spacehog