5 ms·
Softmax just normalizes the logit outputs to be positive and sum to 1.0, it doesn't have an effect on determinism.
by minimaxir 2y ago
Softmax just normalizes the logit outputs to be positive and sum to 1.0, it doesn't have an effect on determinism.
- schoen 2y agoThanks, I guess I confused its role with the adjacent step!