4 ms·

Yeah it would be more surprising if all the hidden state was completely uncorrelated to anything in the output.