4 ms·Exllama is significantly faster if you can fit the whole model in VRAM.by Tostino 3y agoExllama is significantly faster if you can fit the whole model in VRAM.