3 ms·
Yeah my search engine saw traffic of up to 160 queries per second the other day from some bot that was ostensibly searching for information on Jack Parsons. Ju
by marginalia_nu 1mo ago
Yeah my search engine saw traffic of up to 160 queries per second the other day from some bot that was ostensibly searching for information on Jack Parsons. Just variations on the same query in different permutations of filters and site:-terms.
- inigyou 1mo agoThat would be a different bot, one written specifically for your site. Mainly we're discussing the dumb ones that just crawl all possible http links
- marginalia_nu 1mo agoNo I think this is the same case. It seems to just be following local links on the SERP. From a search for jack parsons, you can find hyperlinks to the sorts of requests it's making.