Thank you for your information. I'm looking for tools to save my useful information like other people do. I have two problems with this type of archival tool be

Thank you for your information. I'm looking for tools to save my useful information like other people do. I have two problems with this type of archival tool besides the robots.txt issue: 1. The static snapshot can only give us an idea of what it looked like because it's not functioning, not updating. Better than nothing, but we may have no clue what we want to find other than a few keywords. If you need to search the entire context of the archival, everybody needs to install a mini search engine. 2. If it becomes popular like Google, so many people are going to use it, it will create so much data duplication on everybody's pc, which is helpful but not an efficient solution. Do you like to have a self-organized personal private web on top of the public web via a few clicks? http://bit.ly/1c2DzN6 http://bit.ly/1c2DzN6