4 ms·
> We solved the test flakiness issue by getting rid of all of our frontend tests Getting rid of the whole swath of tests seems extreme, but I am absolutely a p
by jkaptur 5y ago
> We solved the test flakiness issue by getting rid of all of our frontend tests
Getting rid of the whole swath of tests seems extreme, but I am absolutely a proponent of outright deleting flaky tests. If a test has a reputation for being flaky, if people roll their eyes and sigh when it fails, and especially if anyone ever ignores it and submits/merges anyway, then that test has negative value.
"Maybe it will catch something one day" is not a strong enough argument for keeping it around forever. The person making that argument should be arguing to spend the time/effort to make the test not flaky, because tests that people don't trust are just useless baggage.
I think this becomes more true as a product gets bigger and more complicated, because it's more likely that people are changing something they don't fully understand and thus have more of a need to be able to trust the tests.