3 ms·
AI companies are ignoring robots.txt in the race to slurp up the entire internet [1]. [1] https://www.reuters.com/technology/artificial-intelligence/multiple-a
by CrazyStat 2y ago
AI companies are ignoring robots.txt in the race to slurp up the entire internet [1].
[1] https://www.reuters.com/technology/artificial-intelligence/multiple-ai-companies-bypassing-web-standard-scrape-publisher-sites-licensing-2024-06-21/ https://www.reuters.com/technology/artificial-intelligence/m...
- deleted 2y ago[deleted]