4 ms·
Raiders of the Lost Web
- danso 11y agoI would love it if news orgs agreed to at least contribute to Pulitzer.org and put their winning entries online, even as PDF format...Just reading the brief summaries of the winners, it seems like the proper nouns might differ, but the best journalism back then is still as relevant today. There a few entries from 1986 that I've been trying to find for research purposes but are nowhere to be found...it's hard not just to find the full text content, but sometimes the actual headlines and bylines for the team projects: http://www.pulitzer.org/awards/1986 http://www.pulitzer.org/awards/1986 I've thought about going to the library and getting things off of microfiche, but the thought of having to deal with a takedown notice kind of makes me less enthusiastic to try.
- zeveb 11y ago> “The interesting thing is that, at that time [in the 1990s], it was easier to archive the web because everything was flat web pages,” said Alexander Rose, the executive director of the Long Now Foundation, an organization dedicated to establishing a framework for long-term thinking on a scale of 10,000 years. “So if you did save something, your chances of being able to see it and use it would be vastly better than if a company folded today, with deep back-ends of content-management systems like Drupal and Ruby and Django and all these things. The pages are not actual pages.” This right here is something I wish all the folks building web-apps-to-display-pages would think about. It's straightforward to archive HTTP resources; it's not at all easy (nor, really, practical) to archive every API response used in building these dynamic sites. Web apps are fine, for what they are, but please, please, for posterity's sake: don't use dynamic content if you can use static content instead.
- cableshaft 11y agoI used to be all gung-ho about dynamic websites for my personal projects (I made a custom CMS for my site once), but then I started thinking about what would happen if I disappeared and if I wanted to leave my projects for other people to maintain in an easy way (assuming they even want to), and realized static content is the way to go. Now I try to do things client side and powered by data in JSON format instead of creating relational databases and requiring web servers for everything. If I can't copy it to a DVD and have it run in a browser without connecting to the internet, I don't consider it to be good enough. I do have a lot of flash games I need to figure out what to do with now that it's being phased out, though :/.
- digi_owl 11y agoAs best i recall, the first time i ran into HTML was as a content index on a demo CD attached to a magazine. Basically each demo was presented with a screenshot, a text blurb, and a link that would start the installer. All of it static pages using frames.
- blacksmith_tb 11y agoI was a little puzzled by that passage - while it might be true that the content on single-page sites would be harder to crawl / preserve, most of those apps aren't really about content, per se. And most sites that are have some kind of SEO-friendlier slug-based routing that shouldn't really be any harder to consume than a flat, static site, I'd have thought. Not to mention that now sites expose their sitemap.xml, JSON-LD, etc. that should make the job of putting the pieces back together easier than in the Good Old Days this article implies we have left forever...
- vezzy-fnord 11y ago“At this point, if you mean the web when Tim Berners-Lee invented it, right now that web does not exist,” Scott said. “Not really. News organizations kill old articles, YouTube’s old videos go away. And while the Archive and other entities are saving—quote-unquote saving—these sites, even those will go to new URLs. They won’t be in the same place. You’ll have to search for them... There are success stories. But meanwhile, silently, thousands of useful things are disappearing. As time goes on, I have even less and less hope for how long it will last. I can't find any evidence of TimBL ever having any particularly grand intentions regarding the WWW, especially not anything in the like of content replication. In fact, if you read TimBL and Robert Caillau's 1990 proposal for the "WorldWideWeb" [1], you will find it to be a textbook example of worse-is-better with a limited scope, mostly a way of unifying CERN's documents from a physical hierarchy into a minimum viable networked web of nodes. The project objectives were indeed rather humble, and it overall appeared to be a way of bringing the general gist of TimBL's earlier hypertext research with ENQUIRE over the by-then established TCP/IP and DNS in the absolute quickest way possible. Compare and contrast with Ted Nelson and Xanadu. [1] http://www.w3.org/Proposal.html http://www.w3.org/Proposal.html
- williamcotton 11y agoYou make a good point by showing that worse-is-better is probably the way to get there rather than trying to solve everything at once, but I bet when all is said and done we have something that looks a lot closer to Xanadu than the WorldWideWeb!
- vezzy-fnord 11y agoYou make a good point by showing that worse-is-better is probably the way to get there rather than trying to solve everything at once I did not make any such claim, and I do not advocate for any view resembling that in the slightest. I bet when all is said and done we have something that looks a lot closer to Xanadu than the WorldWideWeb If you have read Nelson's writings (e.g. Xanalogical Structure), you will know the two models are fundamentally irreconcilable.
- PavlovsCat 11y agoEven in the short term, link rot can be so maddening. For example, does anyone know where to find the demo described in this article? https://www.unrealengine.com/news/epic-games-releases-epic-citadel-on-the-web https://www.unrealengine.com/news/epic-games-releases-epic-c... Nevermind the technical challenges, there seems to be hardly a culture of this even mattering; other than for transferring page rank to the new location of pages for SEO purposes :/
- starshadowx2 11y agoIt only took one click to find that demo from your link. https://www.unrealengine.com/showcase/epic-citadel/ https://www.unrealengine.com/showcase/epic-citadel/
- PavlovsCat 11y agoI know that, but it links to an app, not the WebGL browser version that the page I linked, and numerous articles all over the web, all are referring to. The words "WebGL" don't even appear on the page.
- technomalogical 11y agohttps://web.archive.org/web/20141024042516/https://www.unrealengine.com/news/epic-games-releases-epic-citadel-on-the-web https://web.archive.org/web/20141024042516/https://www.unrea... Has the article, but the link seems to be to different content (Tappy Bird, not Citadel)
- jccalhoun 11y agoLink rot is pervasive. A study found more than 70% of the URLs within the Harvard Law Review and other journals, and 50% of the URLs found within United States Supreme Court opinions, do not link to the originally cited information. http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2329161 http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2329161 A year or two ago I was doing a project about late 1990s gaming and so many of those sites are gone and were around before archive.org was around. And even if they are on archive.org it is often in a broken state. For example, there were all these Real Audio interviews with people like John Carmack and John Romero and they are just gone. (I actually tracked down one of the people that owned the site in question and he said he had them on a computer in storage and wanted to post them some day...)
- muddi900 11y agoI think comic book scanners, especially those scanning long out-of-print work, can be the perfect example of the trials and tribulations of digital preservation: -The works they are trying to preserve are copyrighted and still trademarked, making it illegal to make copies and distribute them, but a lot of the rights holder themselves see no value in preservation or even reprinting them. -They use P2P technologies to distribute the scanned copies, since it does not require them to host their content on a server. However the tech they use primarily is DC++ a stopgap between Gnutella and BitTorrent, which has a pro that as long as people keep connecting to each other(even momentarily) the comics can be distributed. However it requires a network of 'hubs' to connect users, creating pseudo-centralization. The secondary tech is of course BitTorrent, which is far more widespread and quite easier to use than DC++, but as with every torrent, there is a huge attrition rates and a lot of preservation comics are sitting with very few or no seeds at all. Most of them have even lost their trackers, Demonoid being the biggest one. -There is tertiary level of distribution; Cyber-locker sites. People upload these scans to zippyshare, tusfiles, Mega, etc. and post them on forums. Most of these forums have blocked crawlers in their robots.txt. The biggest source of these is the 4chan board /co/. 4chan threads have very short half-lives, doubly so for threads with these links, because the admins want to pay lip-service to copyright holders, and to be frank, most of the links posted there have no preservative value, but are really a source of pure piracy. 4chan does have third-party archives, but just last week I learned that the archive I used to use has folded. Most cyber lockers themselves don't have long life-spans, and Link-rot is more prevalent in their case. -The fourth level of distribution is imageboards/chans themselves. Some user would 'storytime', post each jpeg in a scaned comic in sequence, a comic if they feel like it, but they too are subject to the imageboard thread half-life. Despite the effort and complexity, DC++ remains the best way to discover old comics lost to time, but one day maintaining a hub would be too expensive or the imminent crackdown on IP infringement would shut them down. This is just for American comics. French/Franco-belgian comics, a far more bigger market, face similar problems. Same goes for Manga.
- angersock 11y agoThis is the frustrating thing, right? We have the means and mechanisms to save all written work, for everyone, for forever, for negligible cost, and yet we aren't allowed to do it. :(