4 ms·
> Try putting an LLM agent in a deterministic workflow without humans in the loop. I would not use a sewing machine to repair my deck :) LLMs are non-determini
by Gareth321 1mo ago
> Try putting an LLM agent in a deterministic workflow without humans in the loop.
I would not use a sewing machine to repair my deck :) LLMs are non-deterministic, by design.
- onion2k 1mo agoLLMs are non-deterministic, by design. They don't have to be though. You can give them a temperature of zero so they pick the highest-probability token every time to give you a deterministic output. I imagine this doesn't work on frontier models because there's a lot going on, but you can definitely do it with a small local model.