4 ms·
That is not the point. There is a physical limit of how much you can compress stuff. If your LLM is significantly smaller than even the most optimized compress
by CrampusDestrus 3y ago
That is not the point.
There is a physical limit of how much you can compress stuff. If your LLM is significantly smaller than even the most optimized compression we can achieve, then it simply doesn't actually preserve all the information
- marginalia_nu 3y agoBe that as it may, 5Gb just isn't realistically significantly smaller than you could squeeze the text of wikipedia.
- bmacho 3y agoIndeed, if the theoretical limit to compress wikipedia is n GB, then you will need n GB at least to create the exact same copy of wikipedia. However you may create a jpg of it. (And you can then remove the artifacts, and even enhance it with AI, and you will get something better than the original wikipedia, to keep the image analogy.)