4 ms·

>I don't understand why they pulled everything off the wayback machine. Someone cannot--as in their request will be rejected--do that unless it's for pages tha

>I don't understand why they pulled everything off the wayback machine. Someone cannot--as in their request will be rejected--do that unless it's for pages that host personal information. Archives still there if you have the original URL*. The problem is, like in many other sites, every few years they move everything around. So you cannot just copy-paste the new URL and expect to find the copies available in the older one. *E.g. the one article that they're unable to find in the submitted one: https://web.archive.org/web/*/https://magic.wizards.com/en/articles/archive/feature/three-year-mirage-2003-04-18 https://web.archive.org/web/*/https://magic.wizards.com/en/a.... Had to use Google myself to find this older archived URL.

boomboomsubban 4y ago
>Someone cannot--as in their request will be rejected--do that unless it's for pages that host personal information The Internet Archive abides by the DMCA meaning it has to take down any material the copyright holder requests. WotC presumably owns the copyright for all the posted content, so very well could demand their archives taken down. From your example I seem to be wrong. I tested one article link I found on the magic wiki and as it had only attempted archives that showed "page not available," I assumed they had been wiped.
- jl6 4y ago
  Note that takedown doesn’t mean delete - it just means inaccessible to the public. IA still hold a copy, and the public will be able to see it again in ~120 years when the copyright expires.
sp332 4y ago
It's really not that hard to get info taken down from IA if you are the site owner. Official blog from 2017 https://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/ https://blog.archive.org/2017/04/17/robots-txt-meant-for-sea... and more recent third-party blog with a survey of several ways to remove content (that you control) from Wayback https://blog.reputationx.com/block-wayback-machine https://blog.reputationx.com/block-wayback-machine
- charcircuit 4y ago
  robots.txt only prohibits people from using the wayback machine to view the archive. The IA still has it archived. If someone later changes the robots.txt to something more permissive it will put back everything on the wayback machine.
  - kappuchino 4y ago
    Wrong. (If you know better than I please cite a credible source). I requested to purge the archive from a domain I have since the former owner put semi legal crap there. Apart from robots text, I was asked to set up one specific page with a hash-like url to signal that I am really, really sure about the purge. Thats all that is needed. The process is described here: https://help.archive.org/help/how-do-i-request-to-remove-something-from-archive-org/ https://help.archive.org/help/how-do-i-request-to-remove-som...
    - sp332 4y ago
      Well there is this example from 2007 https://archive.org/post/133690/robotstxt-only-gives-temporary-removal-of-pages https://archive.org/post/133690/robotstxt-only-gives-tempora...
    - charcircuit 4y ago
      I only have anecdotal evidence from a domain becoming parked with a restricted robots.txt and then it getting unparked and the archive still existing.

boomboomsubban 4y ago

>Someone cannot--as in their request will be rejected--do that unless it's for pages that host personal information The Internet Archive abides by the DMCA meaning it has to take down any material the copyright holder requests. WotC presumably owns the copyright for all the posted content, so very well could demand their archives taken down. From your example I seem to be wrong. I tested one article link I found on the magic wiki and as it had only attempted archives that showed "page not available," I assumed they had been wiped.

jl6 4y ago
Note that takedown doesn’t mean delete - it just means inaccessible to the public. IA still hold a copy, and the public will be able to see it again in ~120 years when the copyright expires.

sp332 4y ago

It's really not that hard to get info taken down from IA if you are the site owner. Official blog from 2017 https://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/ https://blog.archive.org/2017/04/17/robots-txt-meant-for-sea... and more recent third-party blog with a survey of several ways to remove content (that you control) from Wayback https://blog.reputationx.com/block-wayback-machine https://blog.reputationx.com/block-wayback-machine

charcircuit 4y ago
robots.txt only prohibits people from using the wayback machine to view the archive. The IA still has it archived. If someone later changes the robots.txt to something more permissive it will put back everything on the wayback machine.
- kappuchino 4y ago
  Wrong. (If you know better than I please cite a credible source). I requested to purge the archive from a domain I have since the former owner put semi legal crap there. Apart from robots text, I was asked to set up one specific page with a hash-like url to signal that I am really, really sure about the purge. Thats all that is needed. The process is described here: https://help.archive.org/help/how-do-i-request-to-remove-something-from-archive-org/ https://help.archive.org/help/how-do-i-request-to-remove-som...
  - sp332 4y ago
    Well there is this example from 2007 https://archive.org/post/133690/robotstxt-only-gives-temporary-removal-of-pages https://archive.org/post/133690/robotstxt-only-gives-tempora...
  - charcircuit 4y ago
    I only have anecdotal evidence from a domain becoming parked with a restricted robots.txt and then it getting unparked and the archive still existing.