4 ms·
The issue with comprehending LLM's internal workings is just that they're so big. The operation of the network itself is deterministic - but it's output is a se
by taylorius 2y ago
The issue with comprehending LLM's internal workings is just that they're so big. The operation of the network itself is deterministic - but it's output is a set of probabilities over the value of the next token in the stream. At that point you have to choose one, based on that probability distribution, and then start the process again. That choice is where the randomness comes in.
- godelski 2y agoJust to clarify, are you disagreing with me? Correcting me? Adding context for others? I guess I'm missing the intent
- taylorius 2y agoJust adding context, elaborating a little on the deterministic / statistical aspects of an LLM. I don't disagree with what you said, I'm afraid - so not much prospect for a back and forth :-)