3 ms·

Temperature indicates how probabilistic the next word/term will be. If temperature is high, then given the same input, it will output the same words. If the t

Temperature indicates how probabilistic the next word/term will be. If temperature is high, then given the same input, it will output the same words. If the temperature is low, it will more likely output different words. When you query the model, you can specify what temperature you want for your responses.

kgwgk 4y ago
> If temperature is high, then given the same input, it will output the same words. If the temperature is low, it will more likely output different words. The other way around. Think of low temperatures as freezing the output while high temperatures induce movement.
- kenjackson 4y ago
  Thank you. I wrote the complete opposite of what was in my head.
- samstave 4y ago
  So many better terms could have been used ; Adjacency, Velocity, Adhesion, etc But! if temp denotes a graphing in a non-linear function (heat map) then it also implies topological, because temperature is affected by adjacency - where a topological/toroidal graph is more indicative of the selection set?
  - andrepd 4y ago
    Temperature here is used in the sense of statistical physics: a parameter that affects the probability of each microstate.
  - machina_ex_deus 4y ago
    The term temperature is used because they are literally using Boltzmann's distribution from statistical mechanics: e^(-H/T) where H is energy (Hamiltonian), T is temperature. The probability they give to something of score H is just like in statistical mechanics, e^(-H/T) and they divide by the partition function (sum) similarly to normalize. (You might recognize it with beta=1/T there)
  - skygazer 4y ago
    Right, it’s not termed to be understood from the user perspective, a common trait in naming. It increases the jumble within the pool of next possible word choices, as heat increases Brownian motion. That’s the way I think of it, at least.
leereeves 4y ago
> If temperature is high, then given the same input, it will output the same words. It's the other way 'round - higher temperature means more randomness. If temperature is zero the model always outputs the most likely token.

kgwgk 4y ago

> If temperature is high, then given the same input, it will output the same words. If the temperature is low, it will more likely output different words. The other way around. Think of low temperatures as freezing the output while high temperatures induce movement.

kenjackson 4y ago
Thank you. I wrote the complete opposite of what was in my head.
samstave 4y ago
So many better terms could have been used ; Adjacency, Velocity, Adhesion, etc But! if temp denotes a graphing in a non-linear function (heat map) then it also implies topological, because temperature is affected by adjacency - where a topological/toroidal graph is more indicative of the selection set?
- andrepd 4y ago
  Temperature here is used in the sense of statistical physics: a parameter that affects the probability of each microstate.
- machina_ex_deus 4y ago
  The term temperature is used because they are literally using Boltzmann's distribution from statistical mechanics: e^(-H/T) where H is energy (Hamiltonian), T is temperature. The probability they give to something of score H is just like in statistical mechanics, e^(-H/T) and they divide by the partition function (sum) similarly to normalize. (You might recognize it with beta=1/T there)
- skygazer 4y ago
  Right, it’s not termed to be understood from the user perspective, a common trait in naming. It increases the jumble within the pool of next possible word choices, as heat increases Brownian motion. That’s the way I think of it, at least.

leereeves 4y ago

> If temperature is high, then given the same input, it will output the same words. It's the other way 'round - higher temperature means more randomness. If temperature is zero the model always outputs the most likely token.