3 ms·

find | xargs awk?

• toomuchtodo 5y ago
  Wikipedia has a bot that the Internet Archive collaborated on [1], where rotten links are updated to point to the Internet Archive and new links are queued for retrieval [2]. There should probably be a similar effort for CMS systems like Wordpress and such. The code to do this is semi trivial. [1] https://meta.wikimedia.org/wiki/InternetArchiveBot https://meta.wikimedia.org/wiki/InternetArchiveBot [2] https://en.wikipedia.org/wiki/Wikipedia:Link_rot https://en.wikipedia.org/wiki/Wikipedia:Link_rot
  • sp332 5y ago
    But the links here haven't rotted, in that they will not return a 404 or whatever. They will still load videos, it will just be replaced with porn. So you need more code to detect all vidme links as something to fall back to the Archive for.
    • toomuchtodo 5y ago
      In a sense, all of the links for the domain in question have rotted, and must be replaced. To your point, your code could replace wholesale based on the domain.