How does running it multiple times performs? LLMs are non-deterministic, I think benchmarks should be more about averages of N runs, rather than single shot ex

How does running it multiple times performs? LLMs are non-deterministic, I think benchmarks should be more about averages of N runs, rather than single shot experiments.