3 ms·
If you'd read the source you linked you'd see that no, the system is inherently non-deterministic. They cannot sell you a deterministic version of GPT-4. There
by squeaky-clean 3y ago
If you'd read the source you linked you'd see that no, the system is inherently non-deterministic. They cannot sell you a deterministic version of GPT-4. There is no such thing. They could sell you a deterministic version of some other inferior model.
- yorwba 3y agoFrom the source, which I read: As a consequence, the model is no longer deterministic at the sequence-level, but only at the batch-level They could sell you a version where you shove in a whole batch, pay $batch_size as much, and always get the same result for the same batch.