4 ms·
This isn't just a good explainer of quantization, it's a good overview of LLMs in general.
by nazgulsenpai 7mo ago
This isn't just a good explainer of quantization, it's a good overview of LLMs in general.
- opello 7mo agoI think it's a good introduction to quantization generally and specifically in how it applies to reducing LLMs. But I also think it should say something about LLMs or "AI" in the title (as even the article is tagged AI on the author's site) because despite that being an easy assumption to make given the zeitgeist, including the detail would be more clear.