This is a really interesting look at an obviously well thought out interview process. If anyone at GitHub is reading this, I have a question: you mention that s

This is a really interesting look at an obviously well thought out interview process. If anyone at GitHub is reading this, I have a question: you mention that submissions will be graded with automated tests and a rubric. Are these visible to the candidates before submission? If not, what is the thinking behind that? In a real world situation, you would know the acceptance criteria of your work, and invest time up front in writing extensive test cases. My preferred way to work is with tests running in watch mode so I get constant feedback as I work. Are you asking candidates to write tests themselves and comparing which cases they tested to the ones you had expected them to test? Or due to time constraints are you asking candidates to skip testing and only using the tests as an internal gauge for how well they solved the problem?