4 ms·

Fandom sucks. Scraping and republishing their content sucks harder. Disgraziato. Except as expressly permitted by the Company (for example with respect to th

Fandom sucks. Scraping and republishing their content sucks harder. Disgraziato. Except as expressly permitted by the Company (for example with respect to the use of text content that is submitted to particular Fandom communities as permitted as set forth at our licensing page), you may not modify, publish, transmit, reproduce, scrape, create derivative works from, distribute, perform, adapt, aggregate, sell, transfer or in any way exploit any of the content, in whole or in part, -- https://www.fandom.com/terms-of-use

jjmarr 2y ago
https://www.fandom.com/licensing https://www.fandom.com/licensing > Except where otherwise permitted, the text on Fandom communities (known as “wikis”) is licensed under the Creative Commons Attribution-Share Alike License 3.0 (Unported) (CC BY-SA). > To grow the commons of free knowledge and free culture, all users editing or otherwise contributing to wikis that use the CC BY-SA license agree to grant broad permissions to the general public to re-distribute and re-use their contributions freely for any purpose, including commercial use, in accordance with the CC BY-SA license. Such use is allowed where attribution is given and the same freedom to re-use and re-distribute applies to any derivative works of the contributions.
- labster 2y ago
  Using any automation to copy from Fandom is prohibited, and they do not provide backups of images and other media. This means that any attempt to copy a wiki to another host is either a manual process that could take days of downloading, or violation of the computer abuse act and a federal crime. And then they won’t delete your wiki if the community asks for it. Fandom is hostile to forks.
  - technofiend 2y ago
    Isn't that what a DMCA takedown is for?
  - DecentShoes 2y ago
    Using automation to scrape lots of sites is prohibited but the AI crawlers seem to get away with it?
    - toomuchtodo 2y ago
      Can my browser not be an AI crawler?
  - gruez 2y ago
    > or violation of the computer abuse act and a federal crime. I thought the linkedin scraping case set the precedent that anonymous scraping was legal?
    - labster 2y ago
      Maybe it is, I’m old and remember old stuff. Also the rules maybe apply differently under Trump, who knows.
  - pabs3 2y ago
    ArchiveTeam have an automatic process to upload wikis to archive.org, and it works fine for Fandom hosts. https://wiki.archiveteam.org/index.php/Wikibot https://wiki.archiveteam.org/index.php/Wikibot
immibis 2y ago
I don't know if you noticed, but we're at war. You do not win a war by following rules set by the enemy.

jjmarr 2y ago

https://www.fandom.com/licensing https://www.fandom.com/licensing > Except where otherwise permitted, the text on Fandom communities (known as “wikis”) is licensed under the Creative Commons Attribution-Share Alike License 3.0 (Unported) (CC BY-SA). > To grow the commons of free knowledge and free culture, all users editing or otherwise contributing to wikis that use the CC BY-SA license agree to grant broad permissions to the general public to re-distribute and re-use their contributions freely for any purpose, including commercial use, in accordance with the CC BY-SA license. Such use is allowed where attribution is given and the same freedom to re-use and re-distribute applies to any derivative works of the contributions.

labster 2y ago
Using any automation to copy from Fandom is prohibited, and they do not provide backups of images and other media. This means that any attempt to copy a wiki to another host is either a manual process that could take days of downloading, or violation of the computer abuse act and a federal crime. And then they won’t delete your wiki if the community asks for it. Fandom is hostile to forks.
- technofiend 2y ago
  Isn't that what a DMCA takedown is for?
- DecentShoes 2y ago
  Using automation to scrape lots of sites is prohibited but the AI crawlers seem to get away with it?
  - toomuchtodo 2y ago
    Can my browser not be an AI crawler?
- gruez 2y ago
  > or violation of the computer abuse act and a federal crime. I thought the linkedin scraping case set the precedent that anonymous scraping was legal?
  - labster 2y ago
    Maybe it is, I’m old and remember old stuff. Also the rules maybe apply differently under Trump, who knows.
- pabs3 2y ago
  ArchiveTeam have an automatic process to upload wikis to archive.org, and it works fine for Fandom hosts. https://wiki.archiveteam.org/index.php/Wikibot https://wiki.archiveteam.org/index.php/Wikibot

immibis 2y ago

I don't know if you noticed, but we're at war. You do not win a war by following rules set by the enemy.