If you've ever written, taken, or graded take home problems designed to replace whiteboard coding tests, I'd love your feedback. What are the common pitfalls?

If you've ever written, taken, or graded take home problems designed to replace whiteboard coding tests, I'd love your feedback. What are the common pitfalls? Any logistics to smooth the process? How often do you refresh the problem?