The data is freely available: http://aws.amazon.com/datasets/41740 http://aws.amazon.com/datasets/41740 and you just need to comply with the Common Crawl TOU:

The data is freely available: http://aws.amazon.com/datasets/41740 http://aws.amazon.com/datasets/41740 and you just need to comply with the Common Crawl TOU: http://commoncrawl.org/about/terms-of-use/ http://commoncrawl.org/about/terms-of-use/