2 ms·
With the rise of AI, web crawlers are suddenly controversial
- AndyNemmity 10mo agoIt was happening significantly before the rise of AI. It's even more now. I am not sure where exactly we are headed through all this, but I feel like overall having data be a shared commons has been beneficial.
- chistev 10mo agoMaybe everyone would start putting their content behind a wall. Lol.
- JohnFen 10mo agoThat's what I did. I still can't find an effective way of protecting against genAI scrapers while still keeping my sites available without a login.