3 ms·

Here's a Google testing blog post about the same thing in 2016. https://testing.googleblog.com/2016/05/flaky-tests-at-google-and-how-we.html https://testing.go

• zellyn 7y ago
  If any Googlers are reading this and have the knowledge, I’m curious whether things have improved since that article. The numbers are sobering.
  • bhuga 7y ago
    Not a googler, but they posted an update in 2017 with some more information: https://testing.googleblog.com/2017/04/where-do-our-flaky-tests-come-from.html https://testing.googleblog.com/2017/04/where-do-our-flaky-te...
• pytester 7y ago
  I really don't like their series of blog posts of flaky tests. The first one literally used the phrase "fact of life" and implied that nothing could really be done about it (suggesting avoiding high level tests as a result, which was dangerously bad advice) while this one reports a rate that is staggeringly high (16%!) and assumes an intrinsically hard problem ("world class engineers did this!") rather than a fault in their approach. They could do with being a little more humble and focusing on improving their engineering practices.