3 ms·
JPEG compress your LLM weights
- yoss90 2y agoJPEG is unlikely to do a good job in compressing LLM weights, but here is different approach from this weekend (with benchmarks and code). https://github.com/nadavrot/legday/#how-it-works https://github.com/nadavrot/legday/#how-it-works
- billconan 2y agodoes this make sense? JPEG compression is based on the fact that natural images are of low frequency. Are weights also low frequency?