I think the implication is that the freshly checked out state of the files was used. I do agree that reproducible differences in performance should be measured

I think the implication is that the freshly checked out state of the files was used. I do agree that reproducible differences in performance should be measured, not single tests.