3 ms·

we'll see how things play out after the new paper with 1.6 bits and no performance loss. This would mean being able to fit on device much bigger models