4 ms·
It can be more stable by having nightly users test it beforehand for a while and report any new bugs.
by pingyong 7y ago
It can be more stable by having nightly users test it beforehand for a while and report any new bugs.
- chrisseaton 7y agoWhat are those users doing that can’t be automated and run in CI?
- chopin 7y agoTest on exotic hardware, for example. Or exotic combinations of libraries in the OS which FF depends on.
- chrisseaton 7y agoThose should be in the CI test matrix then - we shouldn’t be relying on manual testing done specially for releases.
- chopin 7y agoIf even Microsoft can't catch these, why should Mozilla be able to? I am admittedly not in the CI business for frontends but I'd imagine that the combinatorics vastly outnumbers the possibilities of any organization.
- pingyong 7y agoI'm guessing something the devs haven't thought of. As soon as you hit 10k+ users, chances are people are doing things you didn't expect.
- atroche 7y agoIt'd be pretty ambitious to have CI run against the variety of web apps that real users "test" against (including ones they're developing!)