3 ms·
Essentially anything that happens at inference time also happens at training time. Because training is largely running inference, and then correcting any mista
by eru 5y ago
Essentially anything that happens at inference time also happens at training time.
Because training is largely running inference, and then correcting any mistakes. Over and over again.
(I say largely, because inference also does stuff like sample top-k completions etc.)