5 ms·
I’m an outsider with experience building crawlers. You can get pretty far with residential proxies and browser fingerprint optimization. Most of the b-tier pu
by tonymet 8mo ago
I’m an outsider with experience building crawlers. You can get pretty far with residential proxies and browser fingerprint optimization. Most of the b-tier publishers use RBC and heuristics that can be “worked around” with moderate effort.
- quietsegfault 8mo ago.. but what about subscription only, paywalled sources?
- tonymet 8mo agomany publisher's offer "first one's free". For those that don't , I would guess archive.today is using malware to piggyback off of subscriptions.