4 ms·

I wonder then, if each inference only uses a small part of the net, could you possibly perform multiple inferences in the same forward pass?