3 ms·
How often were you searching?
by jedimastert 6y ago
How often were you searching?
- l72 6y agoI was regularly searching, but I was rarely indexing any of the sites. I struggled to even get an initial index of many of the sites, due to being blocked or being reported.
- jedimastert 6y agoIf you were getting blocked on an initial load, you were either hit with rate limiting or an unrecognized user agent