2 ms·
> But this is just this just doing a forward evaluation of a NN, not training, right? It's been my experience that disabling automatic differentiation for a ne
by ShamelessC 5y ago
> But this is just this just doing a forward evaluation of a NN, not training, right?
It's been my experience that disabling automatic differentiation for a neural net still uses 50-100% as much memory in the forward pass/inference.