4 ms·
Given an input, will it always produce the same output? And will that output be guaranteed to be truthful and correct? And how, exactly, did it arrive at that
by drivingmenuts 1y ago
Given an input, will it always produce the same output? And will that output be guaranteed to be truthful and correct?
And how, exactly, did it arrive at that answer?
- PopePompus 1y agoBy default ChatGPT et al. will not produce the same output if identical input is fed to it multiple times. There is "stochastic sampling" which means that the most probable next token is not always selected. It will select from tokens of similar probability. The degree of similarity required is controlled by the temperature parameter. If the temperature is set to 0, then the model will reproducibility produce the same output (assuming it's always running on the same hardware and the model weights don't get tweeked by an update). But the chatbox front ends do not have the temperature set to 0.