3 ms·
I agree site authors should be able to tell what content they would like to be used for LLM training (even though that opinion will likely be ignored by LLM tra
by imjonse 2y ago
I agree site authors should be able to tell what content they would like to be used for LLM training (even though that opinion will likely be ignored by LLM training scrapers), but the format of it is really up to those gathering and cleaning the data.
It is extra burden for content authors to start thinking about LLM training requirements especially if those may change at a fast pace.
It is also something LLM scrapers would need to validate/check/reformat anyway to protect from errors/trolling/poisoning of the data since even if most authors would provide curated info, not all will.