Not sure if this helps but it could save you some time / money - http://www.80legs.com http://www.80legs.com you should be able to set up a sample crawl for fre

Not sure if this helps but it could save you some time / money - http://www.80legs.com http://www.80legs.com you should be able to set up a sample crawl for free to start to get a feel for the size of the dataset.