3 ms·

You can set temperature to 0 to have deterministic output per model.

• ChatGTP 4y ago
  Only if the model stays the same? As they’re constantly being tuned this is almost never true.
  • mirekrusin 4y ago
    Can you give an example where it matters?
    • ChatGTP 4y ago
      Yes, I’ve seen people at work calling it directly to generate code to talk to APIs with the temp set to zero. They still frequently receive different or broken code.
      • mirekrusin 4y ago
        Shouldn't it be persisted/cached once working, possibly with some test/refine/retry? Requerying everything from scratch when using seems like not optimal solution there?
        • deleted 4y ago
          [deleted]