3 ms·
Looking at HF, it looks like the unquantized version is half the size of glm-5.2 756 GB vs 1.51 TB. I wonder how they were able to optimize it this well
by rew0rk 1mo ago
Looking at HF, it looks like the unquantized version is half the size of glm-5.2 756 GB vs 1.51 TB. I wonder how they were able to optimize it this well
- dannyw 1mo agoFP8 experts not BF16.
- jauntywundrkind 1mo agoFP8 vs BF16. But yeah, nice job.