I saw that it's actually going through all the website urls and makes a request for each. To be optimisitic, each request takes 1 second, that's 1m seconds. Tha

I saw that it's actually going through all the website urls and makes a request for each. To be optimisitic, each request takes 1 second, that's 1m seconds. That's ~10 days, so doesn't seem unrealistic it would actually take ton of time.