4 ms·
I get that temperature comes from the connection to physics but this seems like an overly complex explanation to a relatively simple formula. If you have a soft
by mlazos 4y ago
I get that temperature comes from the connection to physics but this seems like an overly complex explanation to a relatively simple formula. If you have a softmax and you multiply the input by some factor, if that factor forces the exponent to approach zero you’re approaching the uniform distribution, and if you make the exponent approach infinity you get the arg max. Curious if others feel the same way.
- rickdeckard 4y agoAre you suggesting that your explanation is more simple? (genuine question) I find "temperature" quite intuitive as a metaphor in that context. It doesn't even require me to think of the formula to understand "the higher the temperature, the more it will create a stew of the results"
- albystein 4y agoThis is exactly how I understand it. Although, I feel the thermodynamics analogy might be more intuitive to most people