9 ms·
The trouble with this is that, as a software author, it doesn't really matter if it takes 70 seconds instead of 33 to install my software. 70 seconds is fast en
by geofft 11y ago
The trouble with this is that, as a software author, it doesn't really matter if it takes 70 seconds instead of 33 to install my software. 70 seconds is fast enough, for someone who's already decided to start downloading something as involved as Meteor; even if it took one second it wouldn't get me more users. And it would have to take over 5-10 minutes before I start losing users.
On the other hand, having to deal with support requests from users who don't have any decompressor other than gzip will cost me both users and my time. Some complicated "download this one if you have xz" or "here's how to install xz-utils on Debian, on RHEL, on ..." will definitely cost me users, compared to "if you're on a UNIXish system, run this command".
From a pure programming point of view, sure, xz is better. But there's nothing convincing me to make the engineering decision to adopt it. The practical benefits are unnoticeable, and the practical downsides are concrete.
- pslam 11y agoI had to explain the same thing to an engineering team the other day. There was a push to switch from a "fast but ok" compression algorithm to a "faster and better" compression algorithm. This seemed like win-win, but I explained that: * The faster compression made a difference of about 100 milliseconds to a user experience lasting minutes. * The better compression made a different of about 1 second to most users. * The change of compression algorithm would take time away from engineering teams, and ultimately introduce bugs. So in the end it was sidelined until other fundamental changes (file format etc) made it able to be coat-tailed into production. Same story as yours: don't fix what ain't broke. Tallest working radio antenna in the world -> longest lying broken antenna in the world.
- rileymat1 11y agoIs it likely that a user has gzip on a system but not tar itself? From the article: What about tooling? OSX: tar -xf some.tar.xz (WORKS!) Linux: tar -xf some.tar.xz (WORKS!) Windows: ? (No idea, I haven't touched the platform in a while... should WORK!)
- zorked 11y agoTar does not implement decompression. If you don't have xz installed it won't work.
- masklinn 11y agoThat doesn't seem correct, on osx 10.11 `tar xf` can extract `.tar.xz` yet doesn't fork an xz. AFAIK 10.11 doesn't even come with xz.
- jessaustin 11y agotar can link the xz lib without forking.
- masklinn 11y agoSo tar does "implement decompression" (and compression, by delegating the work to libarchive) and it can work even "if you don't have xz installed".
- jessaustin 11y agoIt would require liblzma, but you are correct that the library is a separate thing from the executable xz.
- masklinn 11y ago> It would require liblzma Yep, in the same way it requires libz and libbz2.
- killercup 11y agoIIRC bsdtar (e.g. on OS X) includes xz.
- the_mitsuhiko 11y agoPretty sure tar -xf does not actually work on osx unless you download a recent tar.
- michel-slm 11y agoUsing xz for Linux builds of your software might make sense though, or would do so in the future. Recent releases of Fedora and RHEL already uses xz to compress their RPM packages. Debian/Ubuntu dpkg supports compressing with xz too -- and it's a hard dependency of dpkg at least as far back as the precise (12.04) LTS release. So I'd say the majority of Linux users already have access to xz.
- Taek 11y agoWe started packaging things as .tar.xz for a while, but a large number of users were having terrible trouble opening the file. Mostly Mac, but iirc some Linux users were confused as well. We switched back to gzip because everyone knows how to use it.
- huuu 11y agoThe same applies to OGG audio. Better than MP3 but the average user is unable to play it. So everybody just sticks to MP3.
- danieltillett 11y agoMP3s with a decent bit rate is as good is it gets. Of course something like ogg back in the napster days would have been fantastic, but MP3 at 320 Kbps is fine for anyone who doesn't pay $1000 a meter for speaker wire.
- DanBC 11y agoBut MP3 was patent encumbered and so a bunch of music creation software had weird work-arounds.
- danieltillett 11y agoI am not sure what your point is? Yes MP3 files were not the right choice years ago, but today who cares.
- swhipple 11y agoIf I recall correctly, there are some alive patents in the U.S. until 2017 when dealing with MP3 encoders, requiring purchasing a license per copy distributed. The workaround that the parent is talking about is usually "get LAME from a different distributor", which is still done by Audacity and others.
- 1ris 11y ago
- jwr 11y agoThere are downsides which most young fellas around here don't really appreciate. Hands up, how many of you remember bzip? Not bz2, but bzip, the original one, mostly seen as "version 0.21"? Well, at the time it was released, people were making much the same arguments (with kittens). It compressed so much better than gzip, no reason to use the obsolete gzip format and tools, etc. And some of us jumped on the hype bandwagon and started recompressing our data, only to find out afterwards that bzip2 is now the new thing and the format is not only obsolete, but also patent-encumbered and in general needs to be phased out. From a long-term perspective I'm fine with gzip. At least I know that I'll be able to open my data in 10 years time, which is not the case with bzip-0.21. The jury is still out on "xz", in my opinion.
- nolok 11y agoAgreed, and I think people do not fully understand it because the way it happens is not safety based the way you describe it. The question is not is X safe and Y unsafe, the question is each on its own. Is X safe, and will it still work on old systems or in ten years? Yes, 100%.is y safe and still work in ten years? Well some old system might have issues, and the patents might still exists, and.... If you're a developer, gzip is simply the best option. It's not the best, but it's good enough and it's safe.
- deleted 11y ago[deleted]
- ant6n 11y agoI just started typing in 'xz compression' in Google to learn more about it, it offered 'xz compression not available'. And some more queries that indicate it's not quite ubiquitous.
- kazinator 11y agoIt's good to be informed about the capabilities of xz. I will keep using gzip, but consider xz in situations where the size or time matters. I might not care about 100 megs versus 50 very much, but I will about two gigabytes versus one.