5 ms·
> so almost no one creates truly great "compilations" of stuff, directories, blogs, galleries or whatever I did this for quite awhile using bookmarks, and the
by falcolas 4y ago
> so almost no one creates truly great "compilations" of stuff, directories, blogs, galleries or whatever
I did this for quite awhile using bookmarks, and the link rot is real. If 10% of my historical bookmarks were valid, I’d be pleasantly surprised.
- marginalia_nu 4y agoAnecdotally, my own search engine index starts to feel stale after about two months. I wonder what the half-life of a link is.
- falcolas 4y agoI'm highly tempted to run a "caching" proxy 24x7 just to keep archives of some of these decaying gems around past their lifespan on the web. I'd say I could just use archive.org (or similar), but their (admittedly necessary) respect of robots.txt makes their archive incomplete.
- causi 4y agoI also wish for a modern local archiving solution. HTTRACK just doesn't cut it anymore, unless you really want a local copy of a webcomic that stopped updating in 2003.
- deleted 4y ago[deleted]
- quest88 4y agoI've considered running my own IA (https://github.com/internetarchive/heritrix3 https://github.com/internetarchive/heritrix3), which only archives my chrome history, which is stored in a local sqlite db. I haven't had the time to figure out the details of how the pieces should be glued together.
- kordlessagain 4y agoI use screenshots on my search engine to work around this issue. If you are interested, I have an open server deployment for it.
- RobotToaster 4y agoIt won't help with ones that are already gone, but there's a firefox plugin called Archiveror that automatically archives your bookmarks.