2 ms·
Do your crawls from some place that isn't AWS. I bet there are many obscure data centers that aren't on their list. I was brainstorming for answers to the pay
by PaulHoule 2y ago
Do your crawls from some place that isn't AWS. I bet there are many obscure data centers that aren't on their list.
I was brainstorming for answers to the paywall problem (e.g. system has to see what's behind the paywall) and one answer is a browser extension that can access everything the user's web browser can access (that user subscribes); in many cases this could be made pretty transparent.
- cindycindy 2y ago[flagged]