4 ms·

Very cool. Looks like it might be practical to run 7b models at Q4 on my phone, That would make it truly useful!