The issue in this case is the tests are shipped with the code and not isolated from normal compile steps. Others have pointed it out thos is a normal procedure

The issue in this case is the tests are shipped with the code and not isolated from normal compile steps. Others have pointed it out thos is a normal procedure. One would think these tests should result in a binary hash and that hash gets compared with the production build. Ie, the build for production doesn't need to pass the tests, it just needs the hash of the files that passed.