2 ms·
We are already doing it, as all LLMs are fully deterministic. So we are adding random seed to prompts and control temperature.
by lossolo 3y ago
We are already doing it, as all LLMs are fully deterministic. So we are adding random seed to prompts and control temperature.
- 3cats-in-a-coat 3y agoActually, due to parallel execution they are not running deterministically. Even if the temperature is zero some randomness is left in. You can run a model deterministically, but this is incredibly slow.