When our department was buying a moderately large cluster I remember being surprised by the fact that one of the considerations for the server room was that in

When our department was buying a moderately large cluster I remember being surprised by the fact that one of the considerations for the server room was that in the event of cooling failure you had to make sure there was enough time for the 1600 cores to shut down before the temperature went totally through the roof. I guess the power density of these packed installations is something not easily imaginable if you don't have experience with them...