4 ms·
ctrl+F for Baseline and you'll see a part where they show the two models' outputs with the same prompt. I didn't look closely to see whether this is determinis
by rahimnathwani 3y ago
ctrl+F for Baseline and you'll see a part where they show the two models' outputs with the same prompt.
I didn't look closely to see whether this is deterministic with the right temperature and top_p or whatever.
- iamcreasy 3y agoUh, missed that. Thank you! What do you referring to by temperature?
- rahimnathwani 3y agoDue to the default settings of `top_k`, `top_p`, and `temperature`, which introduce a probabilistic element to token selection, two runs of the same prompt with the same model may yield different outputs. The first two parameters, `top_k` and `top_p`, define the subset of tokens eligible for selection, while `temperature` influences the probability distribution from which tokens are sampled.