4 ms·

No, like the other comment said, it's just using the `n` parameter in an OpenAI style API. For example, vLLM and llamacpp have support for it.

• stavros 3y ago
  Ah, it's the same model, multiple runs, then? Not actually N different models?
  • Tostino 3y ago
    Correct.