2 ms·
Do LLMs inference engines have a way to seed their randomness? so tho have reproducible outputs with still some variance if desired?
by afiori 1y ago
Do LLMs inference engines have a way to seed their randomness? so tho have reproducible outputs with still some variance if desired?
- bavell 1y agoYes, although it's not always exposed to the end user of LLM providers.