2 ms·

I have tried 405B at 1-bit quantization. It remains coherent, but didn't seem to be any better than 3.1-70B.