3 ms·
Yes, it's weird this happens. It's all because this is a conditional model. So it can be influenced by anything in the prompt, including the persona it is assum
by visarga 4y ago
Yes, it's weird this happens. It's all because this is a conditional model. So it can be influenced by anything in the prompt, including the persona it is assuming.
But it is not deterministic. For each token it picks at random, from a probability distribution generated by the neural network. You can make it deterministic if you set temperature=0. In general it is stochastic, if you sample again with the same prompt you get a different answer.