12 ms·
The same is true of some of the best work being done on the web, such as the NYTimes interactive infographics. Because they are so JS-heavy, and reliant on CI/
by rchaud 5y ago
The same is true of some of the best work being done on the web, such as the NYTimes interactive infographics.
Because they are so JS-heavy, and reliant on CI/CD pipelines for deployment, on custom CMSes, there is no way to archive them in the way that static pages containing just text and images can be archived on the Wayback Machine. Heck, even Flash projects from 15 years ago still run fine when compiled on Ruffle or some other Flash player.
- pabs3 5y agoIIRC IA archives full WARCs so replaying all the requests will be fine. The main issue will be browser compatibility with old HTML/CSS/images/JS.
- supermatt 5y agoInteresting (semi-related) video here from the graphics editor of NYT: https://www.youtube.com/watch?v=860d8usGC0o https://www.youtube.com/watch?v=860d8usGC0o
- causi 5y agoDamn I miss being able to drop a URL into HTTRACK and then just having a whole website locally archived with everything working.
- genewitch 5y agoCould one argue that sites that can be backed up in this way (or via save site as: ) are probably worth being backed up, and sites that cannot, are not? I'd be willing to hear counter-examples, for sure.
- anthk 5y agoBack in the day I did that with Slashdot and some Spanish clone too as I didn't have internet at home.
- dzuc 5y agohttps://conifer.rhizome.org/ https://conifer.rhizome.org/ can do it
- brundolf 5y agoHuh? JS can be cached and preserved just like anything else. Even the (presumably JSON or CSV) data could be cached, though I don't know if the Wayback Machine follows API endpoints by default
- spicybright 5y agoBrowsers evolve and break older pages. JS that requires requests as you interact with it will need an implementation of the server it uses (the subset and data of it's endpoints) How do you preserve that?
- deleted 5y ago[deleted]
- tinco 5y agoBrowsers don't usually break older pages. The only time this happens when you rely on unstandardized features. At least, I have not noticed any page breaking in the past 15 years except for the ones I built using unstandardized API's.
- mappu 5y agoThe changing behaviour of browser autocomplete and the new disregard for autocomplete="off" really harmed multiple large CRM / ERP-style sites i worked on, as passwords would get "helpfully" autofilled into completely wrong fields, causing data loss. I actually still don't think there's a proper sanctioned solution to this, it seems to be cat-and-moused by web developers and browser developers every year or two.
- deleted 5y ago[deleted]
- Macha 5y agoThe largest browser maker no longer believes so: https://www.theregister.com/2021/08/05/google_chrome_iframe/ https://www.theregister.com/2021/08/05/google_chrome_iframe/ https://mobile.twitter.com/estark37/status/1422694856544059396 https://mobile.twitter.com/estark37/status/14226948565440593...
- afavour 5y agoI don’t know why CI or a custom CMS would be the problem here, the output is still static HTML. IMO the problem compared to years ago is that the client side dependency trees are so much more complex, involving third party domains and such. But dependencies are still a problem even in Flash: it can load external JSON data for example, and it’s a lot more difficult to sniff all that out than it is with JS. Don’t get me wrong, the web is still miserable in this regard. But IMO it’s the mobile apps that are going to be a giant hole in history: we’ll just have some screenshots to look back on.
- javajosh 5y agoSurely someone is archiving apks, just for the fun of it? I can imagine that someday we'd have a webarchive that embeds a simulation of the device where you can run that apk in your browser. Of course, if it's just an application shell dependent on a running backend, then yes it's not really an application so much as an "application shell" at this point, and you ALSO need to be able to move around the data corpus to systematically capture all reachable application state. This is a hard problem in general, but pretty easy I think when applied to specific cases.
- pharmakom 5y agoThis is why piracy is so important.
- maximedupre 5y agoHaha well that just blew my mind xD I personally don't really care about achieving anything. Why is this such a big thing? Why would we want to achieve all the APKs? There are too many of them lol History? Memories? Who cares, we're all going to die lol And with the qty of APKs, only 0.00000001% of them will ever be dug out of the archives.
- selfhoster11 5y agoIt's definitely feasible to store all APKs. After all, Google does just that. It probably wouldn't even be a significant chunk of what the Internet Archive is currently capable of storing.
- CarelessExpert 5y ago> Because they are so JS-heavy, and reliant on CI/CD pipelines for deployment, on custom CMSes, there is no way to archive them in the way that static pages containing just text and images can be archived on the Wayback Machine. Welcome to the world of digital archiving. It's an enormously complicated space, and even for just my own personal projects and content, I've spent a lot of time thinking about how to ensure things are future proof and can be archived easily. As a simple example, building my personal website atop Markdown ensures that, even if the formatting can't be preserved, the core content will be since it's simple ASCII (yes, that's ignoring issues of long-term digital storage and access and so forth, but at least it's not also a bunch of binary blobs or database formats or whatnot). Equally alarming is that fact that so much of our digital lives aren't even in our control. A historian used to be able to rely on family archives, public libraries, etc, to understand our past. A hundred years from now they'll be looking back and hoping someone somewhere preserved the contents of an S3 bucket before Amazon decided to delete it on a whim...
- tialaramex 5y agoSome people actually use those "takeout" features to collect archive data. So then you do get the archive, it's like having somebody's cuttings from a local newspaper rather than a complete set of local papers on microfiche. One reason I take these is that I have RAM and I have grep and apparently either the people who had the data don't have RAM or they don't have grep, and so while I can ask my local Facebook archive "Er, didn't I write something about anti-freeze?" and get an answer in seconds, Facebook itself will try to suggest I might want pages about anti-freeze, a group that cares about anti-freeze, a sponsored advert for anti-freeze ... and not the thing I wrote.
- romwell 5y agoFacebook's search and suggestion engine is hilariously broken. Say, I am commenting in a thread trying to respond to John Smith. That's the only person whose name starts with a J. If I start typing @J..., the suggestions would be for literally anyone else but John Smith in the thread. On their mobile website (which lags behind the app), typing @John Smith will sometimes suggest a number of John Smiths, none of them being the one in the thread I am writing in. Same with friends. If I want to tag a friend of mine and start typing their name, I usually get suggestions for random people first (neither from my friend list or the comment thread). Why on Earth is the list not prioritized by (friends in thread) / (everyone else in thread) / (friends) / (everyone else) is absolutely beyond me.
- sorry_outta_gas 5y agoAt least the artifacts can be saved and distributed, things like iOS apps have a short shelf-live, hell it only takes a year or two before they can't even be compiled again without modification
- Asmod4n 5y agoJust wait for the first big JS Framework which uses the canvas for everything.
- z3t4 5y agoIve implemented a text editor with screen reader support using the html canvas element. Every graphics interface is just a canvas, what is sent to the screen is just data. The nice thing with html is that the data is human readable.
- Spivak 5y agoThat kind of thing makes indexing a nightmare but it's not any more difficult to archive than .exe or .swf files. Sure you need a "player" but that's true of PDF and OOXML and people don't really complain about those.
- Asmod4n 5y agoIn a PDF or normal program there are clear semantics what is text and what is something else. On a canvas, everything is just made up of pixels. You'd need OCR Software to detect what is what and they won't ever be 100% correct unless you use only text and fonts which are made to be recognized by OCR Software.
- scns 5y agoFlutter allready does it no?
- lgas 5y agoI don't see how JS, CI/CD, or CMSes impact archivability, but something like dependence on API availability instantly ruins archivability.
- kingcharles 5y agoI just got out of jail after 8 years. Went through my del.ici.ous bookmarks. 99% of the sites either dead or can no longer be viewed properly.
- pharmakom 5y agoI would definitely read a blog (or just follow up comments) about a technology orientated person jumping forward almost a decade in time and what they find really different. Are you a professional developer? Has framework churn been an issue?
- maximedupre 5y agoYeah that would be facinating
- kingcharles 5y agoAsk away.
- kingcharles 5y agoYes, been a web developer since 1994. Framework churn is THE WORST. Ugh. Really, nothing in terms of outside appearance has changed. The web looks pretty much identical to when I was locked up in 2013. There are a lot more ads, and way more video ads. The Web uses up waaaay more RAM and CPU. Development, though, has been a bitch since I got out a couple of months ago. I want to use the latest frameworks, but I'm starting from zero again. None of the old frameworks even exist. I feel like I'm 5 years old again. The code I've written in the last few weeks has all been very old fashioned! I just needed to get the job done. I had zero access to the Internet in all that time. The biggest thing I found was TikTok. I fucking love TikTok. From the inside we would see the occasional video on the news, but it just looked like it was to make videos of people dancing, but it's actually fucking awesome for those of us with "neurodiversity". One last thing - out of the, like, 1000 online account I had... only 2 were accessible once I got out. Wikipedia and eSnipe. Can't get into anything else. Don't have ready access to the email address used on a lot of them. The others have an email address on a domain I own, but I can't change the nameservers because I can't get into the account, but my friend paid the domain fees while I was locked up, so I still "own" the domain. I can't get anything back as the court owns all the identity documents that I have and won't let me have them. In fact, when I asked a couple of weeks ago they said they have no idea where they put them all. Oh, and everything is SSL now. That wasn't a thing in 2013. Any other questions, fire away. It's a fascinating topic. I do feel like I teleported 8 years into the future.
- Lochleg 5y agoI have to point out that Ruffle falls shorts on the Flash games that used certain animation or ActionScript features. It's going to be a challenge to fully recreate Flash in a supposedly secure manner. I am also wondering if Flash was always bound to be resurrected and if the company wanted to let it die a natural death or just put it out to pasture.
- 1vuio0pswjnm7 5y agoThis goes against the idea that software is "art" in the sense that most works of art are created to physically endure over time.
- runnerup 5y agothat's just not true. non-recorded performance art is still art.
- 1vuio0pswjnm7 5y agoThe statement is qualified ("most works of art"). Non-recorded performance art is indeed a form of art, but, IMO, it does not comprise "most works of art". I should probably have further qualified the statement to works memorialised in a tangible medium. Programming usually implies "code" that is recorded to a tangible medium. It is usually expected that the "code" may be looked at again after it is recorded.
- runnerup 5y agoI mean, if you want to bring formal logic into this with "(Therefore), the statement is true", then I suppose we can go forth, apply the rules of formal logic, and see what happens. Perhaps I make errors in my analysis and someone can set me straight. It's very strange for you to be that pedantic about the supporting clause without being at all critical of the independent clause. You defended the supporting clause but completely ignored the primary/independent. Independent clause: "This goes against the idea that software is "art" Supporting clause: "...in the sense that most works of art are created to physically endure over time." I was arguing against the primary clause, as it was immediately obvious to me at first read that superficially combining the two clauses yields a "Fallacy of existentialism" (more accurately, it violates the rule that anything distributed in the conclusion must be distributed in at least one premise...but the less correct short quote is easier for readers of this comment to DDG). Laid plainly: A: "Software is not created to endure over time." B: "Some works of art are created to physically endure over time." C: "Therefore, Software is not art." That's not very logical at all. In fact, upon reflection you'll find that I was not arguing against a "straw man" version of their original 'weasel-word' assertion. Instead, before replying(!), I purposefully removed the logical fallacy in an attempt to "steel-man" their argument. I figured that if I could show that a charitably non-fallacious argument of the same character was horribly flawed, that most readers could intuit that any weaker versions of the "steel-man'd" argument would also be some kind of wrong. On a personal note, some unorganized thoughts I'd like to share which I might be convinced to change my beliefs about: I feel that people don't "get" that one can't just add weasel words to magically make a bulletproof argument with instant "gotcha"-trap potential against anyone who tries to rebut their bad/unthoughtful assertions. It's hard (for me) to find examples where weasel words don't do at least one of the following: - Weaken the argument to the point of saying something which is still 100% true and specific, but so trivial/impactless that it doesn't matter in any meaningful application. "Some children receive higher test scores after switching from drinking Pepsi to drinking Coca-Cola". - Create a tautology (a non-falsifiable statement that literally adds nothing to any discussion). "No, really! It very well might be possible that Tupac is still alive!" - Creates a logical fallacy which means that the statement is meaningless. "This goes against the idea that software is "art" in the sense that most works of art are created to physically endure over time." Hopefully this write-up helps other people think, read, and comment more clearly because it took me 40 minutes to craft a complete response to a couple of 20-second Markov Chain comments. The asymmetry is real.
- jacquesm 5y agoI've always been of the opinion that to allow third party content to be embedded in an HTML page was a mistake. URLS within a page that embed content should have been relative to the page itself, never to another host. Of course the current one is much more powerful but both archiving, bitrot and security would have been a lot better served if it all got served from the same host.
- deleted 5y ago[deleted]