3 ms·
Not that it's easy to quantify, but do we know if the interpolation tends to happen at training time or inference time?
by arjvik 5y ago
Not that it's easy to quantify, but do we know if the interpolation tends to happen at training time or inference time?
- eru 5y agoEssentially anything that happens at inference time also happens at training time. Because training is largely running inference, and then correcting any mistakes. Over and over again. (I say largely, because inference also does stuff like sample top-k completions etc.)