3 ms·
Well that I agree with, though mainly because robots.txt is only an ask and can be ignored by scrapers. I do prefer site owners being able to limit how their c
by _heimdall 3y ago
Well that I agree with, though mainly because robots.txt is only an ask and can be ignored by scrapers.
I do prefer site owners being able to limit how their content can be used though. That's individual choice much like choosing a software license for open source code, and totally unrelated to net neutrality as far as I understand it.