Yeah I thought about that, but I've seen cases that a product jumped more than 100%. I used this kind of heuristic to check if a scrape was successful by check

Yeah I thought about that, but I've seen cases that a product jumped more than 100%. I used this kind of heuristic to check if a scrape was successful by checking that the amount of products scraped today is within ~10% of the average of the last 7 days or so