2 ms·
Sure - but that's not the output of the model itself, that's the process of (typically) randomly sampling from the output of the model.
by HarHarVeryFunny 2y ago
Sure - but that's not the output of the model itself, that's the process of (typically) randomly sampling from the output of the model.
- throwaway314155 2y agoRight, sampling from a model, also known as *inference* (for LLM's). The inference here is perhaps less pure than what you refer to but you're talking to human beings; there's no need for heavy pedantry.