4 ms·
Seems a lot like Normalized Compression Distance (https://en.wikipedia.org/wiki/Normalized_compression_distance https://en.wikipedia.org/wiki/Normalized_compres
by woliveirajr 6mo ago
Seems a lot like Normalized Compression Distance (https://en.wikipedia.org/wiki/Normalized_compression_distance https://en.wikipedia.org/wiki/Normalized_compression_distanc...) and Kolmogorov Complexity.
- srean 6mo agoGood compression, necessarily, requires good "next token" probability estimation. I was essentially using zlib's implicit probability estimator.