> If that happens, pretty much the only thing you can do is a hard poweroff. Sounds like a non-swap system/kernel tuning issue - you should still be able to sl

> If that happens, pretty much the only thing you can do is a hard poweroff. Sounds like a non-swap system/kernel tuning issue - you should still be able to slowly switch to a virtual console or ssh in, etc, and kill the test suite.. Also, most linux distros run without any real usage of user/group resource limiting - setting up these appropriately is useful to limit the overall impact of runaway jobs