> a PyTorch implementation delivering 40x speedup over the equivalent batched feedforward inference Does this not indicate a 40x speedup on the GPU? Edit: loo

> a PyTorch implementation delivering 40x speedup over the equivalent batched feedforward inference Does this not indicate a 40x speedup on the GPU? Edit: looking at the paper, their "Naive CUDA" implementation also shows a 117x speedup in Table 2.