3 ms·
> LLMs produce non-reproducible output in response to prompts LLM output is reproducible if you choose the correct settings. (Consumer frontends may not expose
by dragonwriter 2y ago
> LLMs produce non-reproducible output in response to prompts
LLM output is reproducible if you choose the correct settings. (Consumer frontends may not expose those settings, but consumer frontends and LLMs are not the same thing.)
- verdverm 2y agoAdditionally, if you use Gemini/ChatGPT via the VertexAI/OpenAI API instead of the consumer frontend, it become much less moderated, which typically involves running another LLM (among multiple moderation tools) on the response from the underlying LLM