44 ms·
Only if you set temperature to 0 or have some way to set the random seed.
by jnwatson 1y ago
Only if you set temperature to 0 or have some way to set the random seed.
- vlovich123 1y agoLocally that’s possible but for multi tenant ones I think there’s other challenges related to batch processing (not in terms of the random seed necessarily but because of other non determinism sources).