I work in software A/B testing. We have similar problems. The better filter and heuristics is using an algorithm that’s fit for anytime valid testing. The issu

I work in software A/B testing. We have similar problems. The better filter and heuristics is using an algorithm that’s fit for anytime valid testing. The issue here is a high false positive rate. If you come up with all your treatment guidelines in an environment where you check every few hours and change it to every second, you’ve increased your samples by 3,600. Something like heart rate isn’t independent, but that’s still a lot. You need to use a different algorithm (or algo at all) and/or relax the thresholds. Just random numbers, but if 45bpm was an alert before maybe it needs to be 50bpm.