3 ms·

Hate to say but this is probably a FB engineer running a test/experiment and not a production crawler taking robots.txt etc into account.

• mcguire 6y ago
  Or malware infecting some FB-internal machine?
  • x0 6y ago
    Doubt it. If you're a bad enough dude to get control over Facebook's internal infrastructure, I doubt you'd blow that access by using it to spam random sites.