3 ms·

Looks about as effective as Robots.txt

• cgannett 20d ago
  Robots.txt became 0% effective eventually. But this? With the way LLMs work? You never know.
  • Den_VR 20d ago
    People still rail against Robots.txt crimes, to the point of self destructing all their own content.
  • dguest 20d ago
    Claude seems to follow robots.txt by default. Actually at my organization our theory is that this is why no one is finding our public results any more.
  • warkdarrior 20d ago
    I am adding it to my instruction-following training data, as a negative sample.
  • deleted 20d ago
    [deleted]