3 ms·
Because most of the good sites won't let you crawl them any more, unless you're Google.
by Animats 2y ago
Because most of the good sites won't let you crawl them any more, unless you're Google.
- immibis 2y agoCrawl them anyway. Adversarial interoperability is the name of the game.