4 ms·

Seems like it is the 3bit quantized version? (Judging by the file size) And does anyone know how many tokens per second it can run?