4 ms·
Respectfully, this just seems like a few reasons LLM's are frustrating at the moment. Having said that, there is indeed a seed and temperature parameter in the
by throwaway314155 2y ago
Respectfully, this just seems like a few reasons LLM's are frustrating at the moment. Having said that, there is indeed a seed and temperature parameter in the chat/assistant API that will enable (much stronger) determinism. The reason it's not 100% guaranteed to be deterministic is because they may run their model across different hardware, and hardware-level mistakes may accumulate.
With regard to DALLE - that's a fair complaint I didn't realize they don't have a seed for their API. You should really try switching to an open model if you can. You'll have complete control. I recommend flux-schnell or flux-dev.