2 ms·
Honestly Pytorch is weird imo, I'm surprised people love it so much. Loss.backward? Tensor.grad? Optimizer.zero grad()? With torch.no_grad()? What is with all
by kingstnap 1y ago
Honestly Pytorch is weird imo, I'm surprised people love it so much.
Loss.backward? Tensor.grad? Optimizer.zero grad()? With torch.no_grad()?
What is with all these objects holding pointers to stuff? An ndarray is a pointer to memory and a shape my dudes. A gradient is the change in a scalar function w.r.t to some inputs.