3 ms·
> About 10% of the requests do not have the amazonbot user agent. Is there any bot string in the user agent? I'd wonder if it's GPTBot as I believe they don't
by unsnap_biceps 2y ago
> About 10% of the requests do not have the amazonbot user agent.
Is there any bot string in the user agent? I'd wonder if it's GPTBot as I believe they don't respect a robots.txt deny wildcard.
- deleted 2y ago[deleted]