3 ms·
This builds upon something he calls "adaptive quantization algorithm". Basically reducing precision of intermediate values to 8 or 4 bits. Is this something th
by panpanna 7y ago
This builds upon something he calls "adaptive quantization algorithm". Basically reducing precision of intermediate values to 8 or 4 bits.
Is this something that is supported on all GPUs?
- liuliu 7y agoPrecision reduced to 2-bits, with "codebook" of 2 within each 4x4 patch. Similar to https://en.wikipedia.org/wiki/Block_Truncation_Coding https://en.wikipedia.org/wiki/Block_Truncation_Coding but use 1 more bit. There are a lot of tuning left to do to find better ways to encode that reduces MSE.