3 ms·
I think the right term to use here is "more reliable". Setting temperature to 0 will certainly make outputs more reliable for the same inputs. But GPT is inhere
by phillipcarter 3y ago
I think the right term to use here is "more reliable". Setting temperature to 0 will certainly make outputs more reliable for the same inputs. But GPT is inherently nondeterministic both by distributing lossy computations across different devices and using several models under the hood. There's no getting around that when you have enough scale.