3 ms·go make a cost analysis of crawling the entire internet once or twice a day on http vs https and report backby 1oooqooq 2y agogo make a cost analysis of crawling the entire internet once or twice a day on http vs https and report backaaomidi 2y agolol are you claiming that https is done to make web crawling more expensive? Wild.1oooqooq 2y agothe most pressing to google at the time was telecom abusing monopoly of mistyped urls to dictate search engine of their choice. but that too.