4 ms·
I’m measuring the length of the gzipped string in bytes, so K=256. The temperature parameter is there in case anyone wants to play around with it.
by canjobear 3y ago
I’m measuring the length of the gzipped string in bytes, so K=256.
The temperature parameter is there in case anyone wants to play around with it.
- usgroup 3y agoFor anyone else wondering how this works out: 1. You want: p(x) ~ K^(-|x|), where K=256. 2. log p(x) ~ log K^(-|x|) = -|x|log K 3. he is using log(softmax) ~ log(e^x) 4. and log(e^(-|x|log(K))) = -|x|*log K as required.