3 ms·
But they also collect the data without causing denial of service, and respect robots.txt, which is more than you can say of most LLM scrapers...
by smj-edison 11mo ago
But they also collect the data without causing denial of service, and respect robots.txt, which is more than you can say of most LLM scrapers...