4 ms·
Not a fair statement. Google wasn't built on bypassing bot protections. Google is providing a service to the websites they crawl. They try to not crawl when w
by cryptonym 4mo ago
Not a fair statement. Google wasn't built on bypassing bot protections.
Google is providing a service to the websites they crawl.
They try to not crawl when we don't want them (robots.txt, clear user-agent, no-index no-follow...).
- giancarlostoro 4mo ago> Google is providing a service to the websites they crawl. Yeah they're building an LLM and making it pointless to visit the websites.
- cryptonym 4mo agoLet's agree on "Google was providing a service". Current and future state can be questionable. Btw you can still block it.