5 ms·

I don't understand why they pulled everything off the wayback machine. Even if I disagree, I can understand the argument that it's not worth maintaining the old

I don't understand why they pulled everything off the wayback machine. Even if I disagree, I can understand the argument that it's not worth maintaining the old content themselves. But why stop third party archives?

forgotpwd16 4y ago
>I don't understand why they pulled everything off the wayback machine. Someone cannot--as in their request will be rejected--do that unless it's for pages that host personal information. Archives still there if you have the original URL*. The problem is, like in many other sites, every few years they move everything around. So you cannot just copy-paste the new URL and expect to find the copies available in the older one. *E.g. the one article that they're unable to find in the submitted one: https://web.archive.org/web/*/https://magic.wizards.com/en/articles/archive/feature/three-year-mirage-2003-04-18 https://web.archive.org/web/*/https://magic.wizards.com/en/a.... Had to use Google myself to find this older archived URL.
- boomboomsubban 4y ago
  >Someone cannot--as in their request will be rejected--do that unless it's for pages that host personal information The Internet Archive abides by the DMCA meaning it has to take down any material the copyright holder requests. WotC presumably owns the copyright for all the posted content, so very well could demand their archives taken down. From your example I seem to be wrong. I tested one article link I found on the magic wiki and as it had only attempted archives that showed "page not available," I assumed they had been wiped.
  - jl6 4y ago
    Note that takedown doesn’t mean delete - it just means inaccessible to the public. IA still hold a copy, and the public will be able to see it again in ~120 years when the copyright expires.
- sp332 4y ago
  It's really not that hard to get info taken down from IA if you are the site owner. Official blog from 2017 https://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/ https://blog.archive.org/2017/04/17/robots-txt-meant-for-sea... and more recent third-party blog with a survey of several ways to remove content (that you control) from Wayback https://blog.reputationx.com/block-wayback-machine https://blog.reputationx.com/block-wayback-machine
  - charcircuit 4y ago
    robots.txt only prohibits people from using the wayback machine to view the archive. The IA still has it archived. If someone later changes the robots.txt to something more permissive it will put back everything on the wayback machine.
    - kappuchino 4y ago
      Wrong. (If you know better than I please cite a credible source). I requested to purge the archive from a domain I have since the former owner put semi legal crap there. Apart from robots text, I was asked to set up one specific page with a hash-like url to signal that I am really, really sure about the purge. Thats all that is needed. The process is described here: https://help.archive.org/help/how-do-i-request-to-remove-something-from-archive-org/ https://help.archive.org/help/how-do-i-request-to-remove-som...
      - sp332 4y ago
        Well there is this example from 2007 https://archive.org/post/133690/robotstxt-only-gives-temporary-removal-of-pages https://archive.org/post/133690/robotstxt-only-gives-tempora...
      - charcircuit 4y ago
        I only have anecdotal evidence from a domain becoming parked with a restricted robots.txt and then it getting unparked and the archive still existing.
sp332 4y ago
Conversation below the linked tweet says those links have been broken on the actual site since November. You can find them in Wayback by changing /news/ to /articles/archive/ . https://twitter.com/EpiphanyG/status/1617652985919852546 https://twitter.com/EpiphanyG/status/1617652985919852546
- courgette 4y ago
  Oh. So it’s not lost then. If it’s that important, someone should dump them and store them somewhere else. I don’t think we can expect corporations to maintain stuff for free for us forever. They are gonna fuck it up at some point, if not now. In 50 years when hasbro and all its asset is buy by a agricultural tractor manufacturing company with no website and who don’t know what MTG is.

forgotpwd16 4y ago

>I don't understand why they pulled everything off the wayback machine. Someone cannot--as in their request will be rejected--do that unless it's for pages that host personal information. Archives still there if you have the original URL*. The problem is, like in many other sites, every few years they move everything around. So you cannot just copy-paste the new URL and expect to find the copies available in the older one. *E.g. the one article that they're unable to find in the submitted one: https://web.archive.org/web/*/https://magic.wizards.com/en/articles/archive/feature/three-year-mirage-2003-04-18 https://web.archive.org/web/*/https://magic.wizards.com/en/a.... Had to use Google myself to find this older archived URL.

boomboomsubban 4y ago
>Someone cannot--as in their request will be rejected--do that unless it's for pages that host personal information The Internet Archive abides by the DMCA meaning it has to take down any material the copyright holder requests. WotC presumably owns the copyright for all the posted content, so very well could demand their archives taken down. From your example I seem to be wrong. I tested one article link I found on the magic wiki and as it had only attempted archives that showed "page not available," I assumed they had been wiped.
- jl6 4y ago
  Note that takedown doesn’t mean delete - it just means inaccessible to the public. IA still hold a copy, and the public will be able to see it again in ~120 years when the copyright expires.
sp332 4y ago
It's really not that hard to get info taken down from IA if you are the site owner. Official blog from 2017 https://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/ https://blog.archive.org/2017/04/17/robots-txt-meant-for-sea... and more recent third-party blog with a survey of several ways to remove content (that you control) from Wayback https://blog.reputationx.com/block-wayback-machine https://blog.reputationx.com/block-wayback-machine
- charcircuit 4y ago
  robots.txt only prohibits people from using the wayback machine to view the archive. The IA still has it archived. If someone later changes the robots.txt to something more permissive it will put back everything on the wayback machine.
  - kappuchino 4y ago
    Wrong. (If you know better than I please cite a credible source). I requested to purge the archive from a domain I have since the former owner put semi legal crap there. Apart from robots text, I was asked to set up one specific page with a hash-like url to signal that I am really, really sure about the purge. Thats all that is needed. The process is described here: https://help.archive.org/help/how-do-i-request-to-remove-something-from-archive-org/ https://help.archive.org/help/how-do-i-request-to-remove-som...
    - sp332 4y ago
      Well there is this example from 2007 https://archive.org/post/133690/robotstxt-only-gives-temporary-removal-of-pages https://archive.org/post/133690/robotstxt-only-gives-tempora...
    - charcircuit 4y ago
      I only have anecdotal evidence from a domain becoming parked with a restricted robots.txt and then it getting unparked and the archive still existing.

sp332 4y ago

Conversation below the linked tweet says those links have been broken on the actual site since November. You can find them in Wayback by changing /news/ to /articles/archive/ . https://twitter.com/EpiphanyG/status/1617652985919852546 https://twitter.com/EpiphanyG/status/1617652985919852546

courgette 4y ago
Oh. So it’s not lost then. If it’s that important, someone should dump them and store them somewhere else. I don’t think we can expect corporations to maintain stuff for free for us forever. They are gonna fuck it up at some point, if not now. In 50 years when hasbro and all its asset is buy by a agricultural tractor manufacturing company with no website and who don’t know what MTG is.