3 ms·

You're thinking robots.txt https://www.reddit.com/robots.txt https://www.reddit.com/robots.txt and it's still there

• grishka 6y ago
  Not there, but it does have "x-moose: majestic"
  • nitrogen 6y ago
    > User-Agent: bender > Disallow: /my_shiny_metal_ass This was there when I checked just now; was it removed and re-added?
    • grishka 6y ago
      Yes I saw that, but the parent comment said about it being a header ;)
      • hunter2_ 6y ago
        The way I see it, the parent said bender is in robots.txt, and you said it's not, and then you also said x-moose was in robots.txt :) You thought you were replying a level higher.
• jedberg 6y ago
  Ah yes, bender was in the robots file. But we also had a funny X-header. Maybe you can find it in GitHub in the haproxy config.