2 ms·
Not only that, but the same webmasters who try to shoo AI crawlers away actively court Google's bots.
by CamperBob2 5mo ago
Not only that, but the same webmasters who try to shoo AI crawlers away actively court Google's bots.
- cj 5mo agoReally? Every business owner I know outside of HN wants to be discoverable by LLMs.
- iamacyborg 5mo agoBeing discoverable is one thing, having your content stolen wholesale is another
- Polizeiposaune 5mo agoAnd having your content rendered inaccessible to humans by a DDoS attack from overly aggressive webcrawlers that ignore robots.txt is yet another.
- deleted 5mo ago[deleted]
- losvedir 5mo agoMost of the economy is not journalists or people who sell "content" online. In most cases I can think of - retailer, restaurant, hotel, plumber, any local small business, they want their content ingested. That means the AI chatbot knows about them and they can be in answers potentially.