4 ms·
It helps, but it doesn't make it deterministic. LLMs could all be misled together. A different story would be if we had deterministic models, where the exact sa
by hakunin 8mo ago
It helps, but it doesn't make it deterministic. LLMs could all be misled together. A different story would be if we had deterministic models, where the exact same input always results in the exact same output. I'm not sure why we don't try this tbh.
- verdverm 8mo agoI've been wondering if there are better random seeds, like how there are people who hunt for good seeds in Minecraft
- exe34 8mo agoit's literally just setting T=0. except they are not as creative then. they don't explore alternative ideas from the mean.
- hakunin 8mo agoAre you sure that it’s T=0. My comment’s first draft said “it can’t just be setting temp to zero can it?” But I felt like T is not enough. Try running the same prompt in new sessions with T=0, like “write a poem”. Will it produce the same poem each time? (I’m not where I can try it currently).