4 ms·
What's the "garbage in" here?
by alanbernstein 3y ago
What's the "garbage in" here?
- Zetice 3y agoNot totally sure, but based on other folks' comments a number of external sources of noise are possible, e.g. from other conversations or from hitting a weird spot in the training data.
- seba_dos1 3y agoLLMs generate one token at a time, so anytime they happen to generate some garbage for any reason, you get "garbage in" for further tokens for as long as it stays in the context window.