3 ms·
I have a silly website that just proxies GitHub and scrambles the text. It runs on CF Workers. https://guthib.mattbasta.workers.dev https://guthib.mattbasta.wo
by bastawhiz 2y ago
I have a silly website that just proxies GitHub and scrambles the text. It runs on CF Workers.
https://guthib.mattbasta.workers.dev https://guthib.mattbasta.workers.dev
For the past month or two, it's been hitting the free request limit as some AI company has scraped it to hell. I'm not inclined to stop them. Go ahead, poison your index with literal garbage. It's the cost of not actually checking the data you're indiscriminately scraping.
- deleted 2y ago[deleted]
- Eisenstein 2y agoHow does github feel about this? You are sending the traffic to them while changing the content.
- bastawhiz 2y agoFrankly I don't care. They can block me if they want.
- airstrike 2y agoWho cares?
- kuschkufan 2y agoCall the fuzz
- esha_manideep 2y agoThey check after they scrape
- bastawhiz 2y agoThat's a lot of time and bandwidth to waste
- deely3 2y agoHow? Real people read all millions of pages of internet texts to verify it?
- MOARDONGZPLZ 2y agoLooks like it’s just scrambling each individual word. Seems straightforward to programmatically look for groups of things that aren’t legitimate words on a page.