From the source, which I read: As a consequence, the model is no longer deterministic at the sequence-level, but only at the batch-level They could sell you a

From the source, which I read: As a consequence, the model is no longer deterministic at the sequence-level, but only at the batch-level They could sell you a version where you shove in a whole batch, pay $batch_size as much, and always get the same result for the same batch.