4 ms·
It's still surprising because the language model was only trained on text, and is generalizing to compressing other forms of data using in-context learning. The
by Legend2440 3y ago
It's still surprising because the language model was only trained on text, and is generalizing to compressing other forms of data using in-context learning. The model contains no information about images or audio.
But yes, no one is suggesting it as a practical compression tool due to the large size and compute requirements.
- ozim 3y agoIt does not matter bytes are bytes in the end neural network is generic compression model it is predicting next bytes that should show up. For parent - imagine winrar but in cloud so if you don’t pay you cannot decompress your data. There would be no way you could “pirate” it so everyone has to pay not like regular winrar everyone jokes about buying licenses.
- mr_toad 3y agoDownloading an archive and uploading it and then downloading the uncompressed data seems a little counterproductive.
- fxtentacle 3y agoIt was trained "mainly on text" according to the article. So there might as well have been 100GB of images in the training data, too.