One thing I saw was someone logging all system calls their software generated and comparing that between runs. They'd been bitten by some minor library upgrade

One thing I saw was someone logging all system calls their software generated and comparing that between runs. They'd been bitten by some minor library upgrade that had changed directory scanning which caused huge multiples of normal latency which on an SDD wasn't noticeable but on an HDD went from trivial to insane. That was handy because it didn't actually involve testing on a slow device but mostly showed what we needed to know. There are tools like https://github.com/schoentoon/slowpokefs https://github.com/schoentoon/slowpokefs which try to make your fast storage act like a HDD which could be better for black-box testing.