1gn15

11 ms·

1. 151.▲
   by 1gn15 1y ago

   Do you have an ad-blocker? If so, should website owners be able to disable your ad-blocker via a setting they send to you? It's their content, after all.
2. 152.▲
   by 1gn15 1y ago

   Because OpenAI =/= Perplexity.
3. 153.▲
   by 1gn15 1y ago

   https://en.wikipedia.org/wiki/Analog_hole
4. 154.▲
   by 1gn15 1y ago

   > Perplexity crawled it anyway No, they did not. Crawling = recursive fetching, which wasn't what was happening here. But also, I don't think there is anything wrong with ignoring robots.txt. In fact, I believe it is discrimina
5. 155.▲
   by 1gn15 1y ago

   > > We conducted an experiment by querying Perplexity AI with questions about these domains, and discovered Perplexity was still providing detailed information regarding the exact content hosted on each of these restricted domains. Th