2 ms·
"We automatically test not only that the solution complies with the problem definition, but that it works correctly, that it handles edge cases and errors, that
by ilaksh 6y ago
"We automatically test not only that the solution complies with the problem definition, but that it works correctly, that it handles edge cases and errors, that it replies within latency tolerance, and that it keeps working when we throw a lot of load at it.
The candidate only has access to the initial test that gives them early feedback on how they are doing. The rest of the stages are visible only to the hiring manager."
I almost love this, except for the second paragraph. It sounds as if you can't see how well your code performed in latency, load tests, or edge cases. That does not seem like a realistic simulation of work, because normally one would need to iterate a little bit to optimize those things.
I mean I know I would prefer to just do an average job passing the core tests before I try to completely optimize it. Are the candidates even informed that the latency and load tests exist?
I think it could be okay if you just mention that is part of it and there is a straightforward way for them to do their own latency and load testing.. so hopefully that's the case?