3 ms·

I’ve searched for web archival services before, but never found anything outside of some expensive legal services. It would be great if there was a service lik

by new299 8y ago

I’ve searched for web archival services before, but never found anything outside of some expensive legal services. It would be great if there was a service like the waybackmachine but which could be use to archive on demand, and make those archives publicly available. The internet archive is great for this, but they also respect robots.txt and don’t guarantee that they’ll archive pages you request.

geggam 8y ago
Just post some terrorist stuff on there and the NSA will do that for you
Klathmon 8y ago
I know blockchain is a dirty word around here, but this is absolutely an application that can use something like Bitcoin to store hashes of a site on a specific date, giving you the closest thing you can get to "proof" that the site existed on that date with that specific content. Then you don't need "secure" storage of the actual archives, you can have as many copies as possible with as many people as possible and not worry about someone tampering with the archives.
- elwell 8y ago
  https://github.com/ramyhardan/proof-of-existence/blob/master/contracts/ProofOfExistence.sol https://github.com/ramyhardan/proof-of-existence/blob/master...
matt4077 8y ago
archive.org actually has a form for "archive it now", right there on https://archive.org/web/ https://archive.org/web/. They also address using their data in court proceedings in the FAQ. So I think they do have that use case in mind. Of course they'd be stupid to offer any guarantees without payment. That's what their service https://archive-it.org https://archive-it.org is for. Only for organisations, unfortunately. In regard to respecting robots.txt: I would consider any organisation running a bot and not respecting robots.txt as somewhat shady. ignoring it could even have consequences for admissibility in court.
pabs3 8y ago
There are at least 3 locations for on-demand web archiving: https://web.archive.org/save/https://news.ycombinator.com/ https://web.archive.org/save/https://news.ycombinator.com/ https://archive.is/ https://archive.is/ https://webrecorder.io/ https://webrecorder.io/ Probably some of the other sites supported by this extension have on-demand archiving too: https://github.com/dessant/view-page-archive https://github.com/dessant/view-page-archive For archiving on your own computer, this LWN article is pretty interesting: https://lwn.net/Articles/766374/ https://lwn.net/Articles/766374/
- new299 8y ago
  Thanks, webrecorder.io looks particularly good. I’d also forgotten about archive.is I should use that more.
mkj 8y ago
There's https://tlsnotary.org/ https://tlsnotary.org/ which uses the site's own SSL signature to sign the session. No blockchain required!

by new299 8y ago

geggam 8y ago

Just post some terrorist stuff on there and the NSA will do that for you

Klathmon 8y ago

I know blockchain is a dirty word around here, but this is absolutely an application that can use something like Bitcoin to store hashes of a site on a specific date, giving you the closest thing you can get to "proof" that the site existed on that date with that specific content. Then you don't need "secure" storage of the actual archives, you can have as many copies as possible with as many people as possible and not worry about someone tampering with the archives.

elwell 8y ago
https://github.com/ramyhardan/proof-of-existence/blob/master/contracts/ProofOfExistence.sol https://github.com/ramyhardan/proof-of-existence/blob/master...

matt4077 8y ago

archive.org actually has a form for "archive it now", right there on https://archive.org/web/ https://archive.org/web/. They also address using their data in court proceedings in the FAQ. So I think they do have that use case in mind. Of course they'd be stupid to offer any guarantees without payment. That's what their service https://archive-it.org https://archive-it.org is for. Only for organisations, unfortunately. In regard to respecting robots.txt: I would consider any organisation running a bot and not respecting robots.txt as somewhat shady. ignoring it could even have consequences for admissibility in court.

pabs3 8y ago

There are at least 3 locations for on-demand web archiving: https://web.archive.org/save/https://news.ycombinator.com/ https://web.archive.org/save/https://news.ycombinator.com/ https://archive.is/ https://archive.is/ https://webrecorder.io/ https://webrecorder.io/ Probably some of the other sites supported by this extension have on-demand archiving too: https://github.com/dessant/view-page-archive https://github.com/dessant/view-page-archive For archiving on your own computer, this LWN article is pretty interesting: https://lwn.net/Articles/766374/ https://lwn.net/Articles/766374/

new299 8y ago
Thanks, webrecorder.io looks particularly good. I’d also forgotten about archive.is I should use that more.

mkj 8y ago

There's https://tlsnotary.org/ https://tlsnotary.org/ which uses the site's own SSL signature to sign the session. No blockchain required!