4 ms·
I didn't know websites could opt out of providing data to Google's AI training. Looks Google added support for this via 'Google-Extended' in robots.txt back in
by skybrian 15d ago
I didn't know websites could opt out of providing data to Google's AI training. Looks Google added support for this via 'Google-Extended' in robots.txt back in 2023:
https://blog.google/innovation-and-ai/products/an-update-on-web-publisher-controls/ https://blog.google/innovation-and-ai/products/an-update-on-...
- qtqtqt 15d agodoc: https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers#google-extended https://developers.google.com/crawling/docs/crawlers-fetcher...