3 ms·
How sure are we that they're actually LLM scrapers and not just someone trying to DDoS source hut with plausible deniability?
by immibis 2y ago
How sure are we that they're actually LLM scrapers and not just someone trying to DDoS source hut with plausible deniability?
- sksxihve 2y agoThe LLM scrapers could publish the ip ranges they use for scraping like google does, but that would make it easier to block them so they probably wouldn't do that. https://developers.google.com/search/docs/crawling-indexing/verifying-googlebot https://developers.google.com/search/docs/crawling-indexing/...