3 ms·
you'd be within your right to serve the bots fake gibberish data. Maybe they'll crawl less when it starts damaging models.
by lawlessone 1y ago
you'd be within your right to serve the bots fake gibberish data.
Maybe they'll crawl less when it starts damaging models.
- Analemma_ 1y agoThat's only a stopgap measure, eventually they'll realize what's happening and use distributed IPs and fake user agents to look like normal users. The Tencent and Bytedance scrapers are already doing this.