3 ms·
I might have some data gotten through crawling them with Nuuton. Anyone from their team here? I'm going to check. Though not very positive, because I'm not curr
by orangethirty 14y ago
I might have some data gotten through crawling them with Nuuton. Anyone from their team here? I'm going to check. Though not very positive, because I'm not currently scrapping ever single page completely.
Bad news update:
I had not covered the wiki yet. The crawler seems to have ventured off to SO (the crawler runs 24/7 by itself). I'm so sorry. :(
- eqreqeq 14y agoNot to sound rude but what are you talking about? Why are you even apologizing?
- lylejohnson 14y agoI think he's saying that he set up a web crawler to scrape python.org, and he was hoping that in the process it had made copies of those Wiki pages. He's apologizing that, as it turns out, the crawler did not make it to those pages after all.
- orangethirty 14y agoExactly. I thought my crawler had covered all of python.org, but it strayed off to stack overflow. Had not noticed due to the sheer amount of data it goes through. On one side, this sucks because I cannot help put the wiki back online. One the other, this led me to discover this bug.
- dbecker 14y agoI'd expect they'll find a way to restore the wiki content. The bigger concern is that someone downloaded their password file.