I think the assumption that many important Hadoop applications run in a while(true) loop is a bit naive, exactly because you would expect this kind of build-up

I think the assumption that many important Hadoop applications run in a while(true) loop is a bit naive, exactly because you would expect this kind of build-up on any traffic spikr or performance degradation.