LLMs can be deterministic if you set the random seed and pin it to a certain version of the weights. My bigger concern would be bugs in the machine code would

LLMs can be deterministic if you set the random seed and pin it to a certain version of the weights. My bigger concern would be bugs in the machine code would be very, very difficult to track down.