2 ms·
Yup, and unlike the original turboquant paper, my implementation is pinned to using a 4 bit code book so I could use SIMD kernels for performance.
by mxfeinberg 3mo ago
Yup, and unlike the original turboquant paper, my implementation is pinned to using a 4 bit code book so I could use SIMD kernels for performance.