Maybe the CTO should post his database on Github. If he wants the test code to function under certain conditions, he needs to publish those exact conditions. No

Maybe the CTO should post his database on Github. If he wants the test code to function under certain conditions, he needs to publish those exact conditions. Not specifications, but the actual data that the test will be run against. If he's not comfortable doing that because it's restricted intellectual property, I might wonder what the real purpose of the test was.