Unfortunately vLLM (the open source inference engine we're built on) doesn't support exl2. That being said I want to add additional backends so we can support e

Unfortunately vLLM (the open source inference engine we're built on) doesn't support exl2. That being said I want to add additional backends so we can support exl2 as well!