8 ms·
In principle, training is basically the same as running inference but iteratively, in practice training would use a different software stack.
by frozenport 3y ago
In principle, training is basically the same as running inference but iteratively, in practice training would use a different software stack.
- robrenaud 3y agoTraining requires a lot more memory to keep gradients + gradient stats for the optimizer, and needs higher precision weights for the optimization. It's also much more parallelizable. But inference is kind of a subroutine of training.