4 ms·
> that I don’t blame site owners for blocking all bots except googlebot I run a number of sites with decent traffic and the amount of spam/scam requests outnum
by threeseed 1y ago
> that I don’t blame site owners for blocking all bots except googlebot
I run a number of sites with decent traffic and the amount of spam/scam requests outnumbers crawling bots 1000 to 1.
I would guess that the number of sites allowing just Googlebot is 0.