It doesn't look like the intent of this system is to detect price gauging, etc. but rather to detect service outages/disruptions. Agree that high variance makes

It doesn't look like the intent of this system is to detect price gauging, etc. but rather to detect service outages/disruptions. Agree that high variance makes 'jump-based' methods such as this fail a lot. The associated paper claims a 30% false positive rate. But in the case of a true positive, if you know which metric is failing, then that's a very good jump off point to respond to the disruption. Having benchmark datasets could mean more semi-supervised approaches, compared to unsupervised approaches (such as this one). But - what would the end-result be? Everyone has different metrics, so unless you merely use the datasets as raw numbers to feed into an algorithm, you're unlikely to get meaningful results.