4 ms·
Not respecting robots.txt is the only legitimate concern you list here. The marginal cost of one page load is approximately 0, and this is not a fuzzing tool.
by pc86 4y ago
Not respecting robots.txt is the only legitimate concern you list here. The marginal cost of one page load is approximately 0, and this is not a fuzzing tool.