7 ms·

Wonder what the story is behind these two... User-Agent: bender Disallow: /my_shiny_metal_ass User-Agent: Gort Disallow: /earth

• iso1210 5y ago
  Easter eggs
• pluc 5y ago
  It's neckbeard humor.
  • jedberg 5y ago
    I'll have you know our beards were neatly trimmed when we added those.
    • pluc 5y ago
      I know you, and I find that hard to believe ;)
• gostsamo 5y ago
  It might be related to the time few years ago when Google added exclusions for user agent t1300 in regard to its founders. Gort seems to be a robot from old scifi and bender might be something similar.
  • h2odragon 5y ago
    Bender is from Futurama, Gort is old classic scifi: https://en.wikipedia.org/wiki/Gort_(The_Day_the_Earth_Stood_Still) https://en.wikipedia.org/wiki/Gort_(The_Day_the_Earth_Stood_...
• deleted 5y ago
  [deleted]
• toastal 5y ago
  I reod some people use false slugs in the robots.txt as a honey pot of sorts. IPs that actually read the robots.txt, ignore the disallow, and still access the uri are outright banned.
  • jedberg 5y ago
    Ha, that would have been a really smart idea! Sadly we didn't think of that at the time. But we had other honey pot URLs.
  • taylorfinley 5y ago
    Then when a flamewar breaks out you just have to get your adversary to click a link to get them IP banned.
• gaius_baltar 5y ago
  That's the good old Easter eggs, perhaps a memory from when Reddit was a nice place. They stop appearing and are replaced by dark patterns once sites jump the shark.
• jedberg 5y ago
  Just some fun humor we added for other nerds who read robots.txt files.