3 ms·
> they only activate some parts of the model for each input Perhaps you see seemingly random results because OpenAI is A/B testing multiple versions, or differ
by panarky 3y ago
> they only activate some parts of the model for each input
Perhaps you see seemingly random results because OpenAI is A/B testing multiple versions, or different combinations of hyperparameters, so that you can train GPT5.
- mlyle 3y agoNah; the mentioned paper above (from a few days ago here on HN) show about how GPT4 is nondeterministic because the sparse mixture of experts technique used is nondeterministic based on batch positioning.
- deleted 3y ago[deleted]