Well pound for pound most websites want to sell ads to human eyes and categorically block any robot that doesn't have a human piloting it. Your best bet at fin

Well pound for pound most websites want to sell ads to human eyes and categorically block any robot that doesn't have a human piloting it. Your best bet at finding standardized public data is projects that _want_ to be read and stored and don't make money, like Wikipedia