jaspervanveen

2 ms·

1. 1.▲
   by jaspervanveen 8mo ago

   Fair pushback. A few angles: 1. The premise is partly wrong. Major commercial agents -- the ones with legal teams and reputational risk -- already follow robots.txt. Google, Bing, all the big crawlers comply. The ones that don't were a
2. 2.▲
   by jaspervanveen 8mo ago

   Author here. A few things that didn't fit in the README: The immediate trigger was realizing that robots.txt, unchanged in spirit since 1994, is now being applied to systems that can book your flights and empty your bank account. The m
3. 3.▲
   Show HN: Agents.txt – proposed standard for AI agent permissions on the web(github.com)

   2 points by jaspervanveen 8mo ago|3 comments