You physically can't put a crayons under the hat on the fly. Similarly in the equivalent digital experiences, the prover commits to a value and must be able to

You physically can't put a crayons under the hat on the fly. Similarly in the equivalent digital experiences, the prover commits to a value and must be able to prove that it didn't change it (for instance it must provide the verifier a hash of the chosen color + some random salt).