3 ms·
> Can anyone but google scrape the web? No. Tons of websites won't let you unless you are googlebot. I though cloudfare has some way to onboard other bots too.
by riku_iki 4y ago
> Can anyone but google scrape the web? No. Tons of websites won't let you unless you are googlebot.
I though cloudfare has some way to onboard other bots too.