2 ms·
Yes, the raw data feeds have occasional blips like that (more so in some stations than in others). It is a top priority to write some good automatic quality co
by jrd79 16y ago
Yes, the raw data feeds have occasional blips like that (more so in some stations than in others).
It is a top priority to write some good automatic quality control code, but we didn't want to do a bad job and end up accidentally filtering out real data (we've discovered, for example, that some of NOAA's quality control filters have very high rates of incorrectly deleting measurements that are actually extremely plausible).
We want to take a proper statistical approach, which requires labeling a lot of examples of these kinds of blips, and we just haven't had time to do that yet.
- aquark 16y agoI'm not sure this is a raw data blip, since it seems to change based on the zoom level. 19C appears to be the historical high for that day, but is sometimes included in the band indicating the actual range.
- jrd79 16y agoIt is definitely a blip. The reason it doesn't appear in all the zoom levels is that the four-hourly zoom level takes the average temperature of the hourly data over the four-hour period. Once you go up to the daily zoom level we switch to showing the high and the low, and you can see the blip again. That historical high is due to that point. Actually, I'm just sitting down today to start the process of writing quality control filters to get rid of this sort of blip. So hopefully it will be gone soon! :)