2 ms·
Hmm, idk. I don't like their modeling approach. Their dependent variable is the number of crashes per hour, scaled by the "population average" for segments of
by spywaregorilla 3y ago
Hmm, idk. I don't like their modeling approach.
Their dependent variable is the number of crashes per hour, scaled by the "population average" for segments of the same length. I guess this is fine so long as you look at the same areas. They give two tests to try and control. One is checking upstream crashes but I kind of suspect the signage is positioned where you're supposed to be extra careful due to increase risk, so that may not be relevant. The other is looking at the same areas before and after. This does seem like a fair argument.
They also include specific effects for exact date-hour combos, but I feel like this is a bad approach as you would want to ideally capture higher level weekday + hour seasonality traits; not specific date hours.
They say on the multi variate:
> In particular, we show that clustering by segment-year-month reduces the standard error in half, clustering by just geography produces slightly smaller standard errors, controlling for rain more flexibly does not affect our results, not controlling at all for rain doubles our estimated treatment effect, not controlling for holidays increases our estimate slightly, and dropping hours immediately before and after campaign weeks (i.e., hours outside of campaign weeks that sometimes display fatality messages, see fig. S6) further increases our estimate
Which implies a lot of it may be random sample bias of the test set all being on worse weather days, even if they try to control for it here.
Regardless. I think it's a plausible analysis. The effect size is just 1-2% though.
- hedora 3y agoHow do they control for situations where the sign is displaying a traffic alert that preempts the informational display? Presumably, if the sign is displaying "congestion ahead" warnings, then traffic has often already slowed to a crawl, which could lead to a few percentage point decrease in crashes. Also, unless the signs were placed poorly, they're likely in high-congestion areas, and frequently toggling between normal and congested display modes.
- spywaregorilla 3y agoSeems they're looking at the same areas across their analysis. That is, they always have signs. The question is whether the signs are specifically within the campaign period showing the crash number message.