3 ms·
User agent matching isn't good enough. The stakes are high -- all it takes is one AI crawler to grab my site data, and that data is included in the training for
by JohnFen 3y ago
User agent matching isn't good enough. The stakes are high -- all it takes is one AI crawler to grab my site data, and that data is included in the training forever more.
> if they're determined to be sneaky they will succeed at scraping.
Yes, which is why I suspect I will never be able to open my websites up to the general public again. I live in hope anyway.