I "scrape" some sites[0], generally one time, using a single thread, and my crap home internet. On a good day i'll set ~2mbit/sec throttle on my side. I do this

I "scrape" some sites[0], generally one time, using a single thread, and my crap home internet. On a good day i'll set ~2mbit/sec throttle on my side. I do this for archival purposes. So is this generally cool with everyone, or am i supposed to be reading humans.txt or whatever? I hope the spirit of my question makes sense. [0] my main catchall textual site rip directory is 17GB; but i have some really large sites i heard in advance were probably shuttering, that size or larger.