3 ms·
Does this respect any anti AI related scraping rules set forth by website owners?
by pryelluw 3y ago
Does this respect any anti AI related scraping rules set forth by website owners?
- duskwuff 3y agoIt doesn't even respect general robots.txt exclusions, so... I doubt it.