3 ms·

2B weights is not too big, so with some compression + sparsity + down-sampling it will run on any device offline