3 ms·
Would someone even want to circumvent it though? Most sites won't care very much about encouraging scrapers to include them in LLM training data, it's not like
by sebzim4500 2y ago
Would someone even want to circumvent it though? Most sites won't care very much about encouraging scrapers to include them in LLM training data, it's not like you get paid.
- DSingularity 2y agoIf your website is created to promote a product of course you are incentivized to be included.