4 ms·
Why AWQ instead of exl2?
by lxe 2y ago
Why AWQ instead of exl2?
- reissbaker 2y agoUnfortunately vLLM (the open source inference engine we're built on) doesn't support exl2. That being said I want to add additional backends so we can support exl2 as well!