3 ms·
> It's not a system that we should copy for preventing the use of content in training AI I don't see the OP saying anything about "ai.txt" being for that? The
by jefftk 3y ago
> It's not a system that we should copy for preventing the use of content in training AI
I don't see the OP saying anything about "ai.txt" being for that? They're advocating it as a way that AIs could use fewer tokens to understand what a site is about.
(Which I also don't think is a good idea, since we already have lots of ways of including structured metadata in pages, but the main problem is not that crawlers would ignore it.)
- kmoser 3y agoNot only do we already have lots of ways of including structured metadata, but if you want to include directives about what should/shouldn't be scraped and by whom, we already have robots.txt. In other words, there's no need to create an ai.txt when the robots.txt standard can just be extended.