4 ms·
How does this project compare to https://github.com/gavamedia/deltafin https://github.com/gavamedia/deltafin ?
by roundup 2mo ago
How does this project compare to https://github.com/gavamedia/deltafin https://github.com/gavamedia/deltafin ?
- chrisringrose 2mo agoHi! I'm one of the deltafin devs. The biggest difference is that this is not actually a 100% "pure" uncut Kimi K3. This is requantized to 3-bit residual, whereas deltafin is the full real unaltered k3, through and through. WASTE reads about 17 GB/token versus Deltafin’s 25.8 GB/pass—roughly. That's 34% less expert traffic, and some could argue a 34% reduction in quality.
- withinboredom 2mo agoWhy quantize to int8 when k3 is int4? I could be wrong, but that’s what I remember seeing.