4 ms·

Why int4? There are a lot of superior 4 bit formats like nf4 from bitsandbytes.

• Tepix 2mo ago
  Well, INT4 is good enough apparently and it's very fast.