This makes me wonder what a next-gen datacenter would look like; far more control points, far more data gathering, probably some combination of high- and low-in

This makes me wonder what a next-gen datacenter would look like; far more control points, far more data gathering, probably some combination of high- and low-inertia cooling with different characteristics -- essentially you are going to want to start giving your NN more knobs to tweak. That seems very singularity/jackpot-ish to me. Cool, but will have some interesting unexpected consequences, I bet.