3 ms·

Because Anthropic already admitted it? [0] [0] https://www.ft.com/content/07611b74-3d69-4579-9089-f2fc2af61baa?syn-25a6b1a6=1 https://www.ft.com/content/07611b

• inigyou 26d ago
  It says "accused of"
  • shakna 26d ago
    ... It also has a quote from Anthropic, admitting they backed off their scraper after a robots.txt update.
    • inigyou 26d ago
      Nobody who gives a shit about their software actually working obeys robots.txt. most robots.txt block everything except googlebot, which is an insane policy and you don't have to follow it.
      • shakna 26d ago
        Which isn't all that relevant a discussion here. Anthropic saying they did so in this case, means that they admit they were the scraper flooding the domain.