4 ms·
I am planning on doing a site rip for my personal reference, in case I need to leverage any of these documents in the future. I've never used the site before b
by turc1656 9y ago
I am planning on doing a site rip for my personal reference, in case I need to leverage any of these documents in the future. I've never used the site before but it seems like a nice resource that I would like to have.
If I do the site rip are you interested in obtaining a copy?
EDIT - in case it wasn't obvious, I am only interested in and referring to the publicly available documents aspect of Docracy, which is what I assumed you were talking about. But I realize you may be using their other, private features like holding private contracts and digitally signed documents. If you are interesting in my pending rip of the freely available documents, let me know.
- manglav 9y agoI'd be interested in that! I wonder how much it would cost to just host and serve via s3...
- turc1656 9y agoI don't see a direct/private message feature here on HN, but I see your email in the about section of your profile. I will follow up with you when I get the script together over the next week or so. The HTML looks very straightforward. Should be easy for me to adapt another script I have for another site.
- t0mbstone 9y agoSure! I'm definitely interested! Thank you for doing that work. I was thinking about doing it myself, to be completely honest...
- turc1656 9y agoWould you mind putting your contact email in your profile? The other commenter intersted in this (manglav) already has this in their profile. I need a way to contact you. FYI - this should be done very shortly. I ran the script last night to scrape the site of all the relevant info. The actual download of all the files is running right now.
- t0mbstone 9y agoI'd rather not publicly tie my email address to my hacker news profile... Is there any way you could reply to this comment with a download link? I would also be happy to tip you some bitcoin for your trouble, if you give me a bitcoin address
- turc1656 9y agoNo need for the BTC, but I appreciate the offer. https://www.4shared.com/zip/AdAKc8akca/Docracy_Site_Rip.html https://www.4shared.com/zip/AdAKc8akca/Docracy_Site_Rip.html You'll need a (free) account to download from that site if you don't already have one. You can create one just for the site or you can use Facebook, Twitter, or Google to log in. I recommend creating a regular, unlinked account. The main Excel excel file is the actual HTML scrape for the data I pulled. It's pretty self explanatory. The documents directory holds all the files. The filenames match exactly what is in the Excel file except that they are also prefixed with the unique ID the site assigns for every document to avoid filename collisions. 200mb unzipped. There are 12 "documents" on that site that were actually just pages that contain mini-blog entries that are links to multiple contracts because they are, for example, things like "contracts for your personal life" and "top legal documents for freelancers". I added "topic, group, multiple" to the tags and keywords columns in Excel to identify these items.