3 ms·You are right, inference only uses one single v100 according to the paper.by speedgoose 4y agoYou are right, inference only uses one single v100 according to the paper.