6 ms·
Let’s not forget that a decompressor for such a format would necessitate running the entire model, i.e. in this case, a 70B parameter decompressor. It’s perhaps
by nneonneo 3y ago
Let’s not forget that a decompressor for such a format would necessitate running the entire model, i.e. in this case, a 70B parameter decompressor. It’s perhaps not surprising that you can compress files better when given a (very) large dictionary to refer to. This is why any reasonable compression benchmark includes the decompressor’s size in the size score.
- Legend2440 3y agoIt's still surprising because the language model was only trained on text, and is generalizing to compressing other forms of data using in-context learning. The model contains no information about images or audio. But yes, no one is suggesting it as a practical compression tool due to the large size and compute requirements.
- ozim 3y agoIt does not matter bytes are bytes in the end neural network is generic compression model it is predicting next bytes that should show up. For parent - imagine winrar but in cloud so if you don’t pay you cannot decompress your data. There would be no way you could “pirate” it so everyone has to pay not like regular winrar everyone jokes about buying licenses.
- mr_toad 3y agoDownloading an archive and uploading it and then downloading the uncompressed data seems a little counterproductive.
- fxtentacle 3y agoIt was trained "mainly on text" according to the article. So there might as well have been 100GB of images in the training data, too.
- ramesh31 3y agoCould a distributed decompressor be valid? I. e. something like bittorrent that provides a DHT for known files.
- dmajor2 3y agohttps://qwantz.com/index.php?comic=2092 https://qwantz.com/index.php?comic=2092
- nick-of-time 3y agoThis has been implemented: https://github.com/philipl/pifs https://github.com/philipl/pifs
- m16ghost 3y ago> Therefore, inside pi is contained every discovery and every work of art! Is this actually true? It is not clear to me that pi necessarily contains every possible sub-sequence.
- deleted 3y ago[deleted]
- mr_toad 3y agohttps://math.stackexchange.com/questions/216343/does-pi-contain-all-possible-number-combinations#216350 https://math.stackexchange.com/questions/216343/does-pi-cont...
- m16ghost 3y agoThanks. What I am getting from this is that pi is believed to have this property, but proving this is still an unresolved problem.
- bastawhiz 3y agoIf you have to fetch one or more dictionaries to decompress the file anyway, why not just include the dictionary with the file you need to decompress?