3 ms·
Good compression, necessarily, requires good "next token" probability estimation. I was essentially using zlib's implicit probability estimator.
by srean 5mo ago
Good compression, necessarily, requires good "next token" probability estimation. I was essentially using zlib's implicit probability estimator.