Sun actually did something like that for their Enterprise Architect certification, which had three parts: first a multiple choice test, then a take-home design

Sun actually did something like that for their Enterprise Architect certification, which had three parts: first a multiple choice test, then a take-home design for a system (given these requirements, produce some UML diagrams), and finally some essay questions about the design (the one I remember was how the design adresses scalability).