3 ms·

> At least 32GB of RAM is recommended to run cmix. Youch! I totally get what they're trying to do here and that one day even the cheapest toy will have 10x th

• DannyBee 11y ago
  Considering it is is 30-300x slower as its nearest competitors, ram is your smallest problem ;-) (see http://mattmahoney.net/dc/text.html http://mattmahoney.net/dc/text.html) Note that sadly, decompression is equally as slow, so it doesn't even make a lot of sense for something that is "compress once, distribute billions of times".
  • dllu 11y ago
    The aim of cmix is to use as many context mixing models as is necessary to get the best possible compression ratio as an academic exercise. Little attempt was made to make it faster or use less memory. That said, the author recently communicated to me an idea to make it use orders of magnitude less memory. Instead of running all the context models in one pass while storing all their states, one could run each model in a separate pass, so that only the memory for one context model needs to be stored at any point in time. Since the original program was not multithreaded, this does not affect the running time. Unfortunately that requires rewriting the whole thing and he is preoccupied with other projects at the moment.