4 ms·
It should only scrape the front page once per run as an initial condition to unleash the other requests. But thanks for the heads up! I'll be sure to mention
by mvanveen 15y ago
It should only scrape the front page once per run as an initial condition to unleash the other requests. But thanks for the heads up!
I'll be sure to mention this in the docs.
Edit: changes have been posted. Thanks for the suggestion!