4 ms·
The article is just about the qualification round. The first post-qualification round was even worse (I was a competitor). I won't go through all the details,
by feral 16y ago
The article is just about the qualification round.
The first post-qualification round was even worse (I was a competitor).
I won't go through all the details, but problems included mis-specified questions.
The second question - a 2 variable optimisation problem, set as a Starcraft game problem, in which shield generators cost X and warriors cost Y, and you had some rules about the cost/benefits of each - asked you to report the number of warriors to build, to maximise damage done.
Writing code to solve this, it quickly became clear that the sample answers provided were wrong.
Mid way through the competition, they changed the question to require you to output the number of shields to build - which, of course, made the sample output make sense.
While they put up a post mid competition saying they suspected a bug in the question, they did not subsequently make any communication that they had changed the question, or confirm the error. No text was added to the question page notifying competitors it had changed. No confirmation of the change was officially made, afterwards.
(You can verify this independent of my comment by reading the competition walls, or googling - the question was called 'power overwhelming').
Another issue - while they were technically correct - was where they said input to the first question would be whitespace separated, and give training examples showing it space separated, but then the test problems were Newline separated. While its debatable whether Newline is whitespace (I'd say it is, but it typically doesn't match \s) this change from the training examples to the test confused a lot of people - and its bad programming competition form, to trip people up in the input specification.
Finally, due to the slew of problems in the round, they closed the round early, without warning. This upset competitors who came to submit their solutions, to find that the round had already closed.
AFAIK, they still have not clarified whether competitors from that round that answered questions will progress, or will all have to redo it.
Communication - including on topics such as rules - has been sporadic, and either via e-mail, or through posts left on the wall - sometimes in comments on the competition wall, rather than in organised FAQs, or using the facebook notification system.
Answer upload has also been temperamental for certain browsers.
But posing a programming competition question to 1000s of competitors, where the actual question is mis-specified - that's a very big error.
Rescheduling the succeeding sub-rounds at the last minute also inconvenienced a lot of programmers who had taken time out of their schedules to do it.
Its a programming competition, and its just for fun - but I'd like to think they'd do a better job considering the volume of contestants, and the wide external audience.
- mdwrigh2 16y agoThe qualification round actually had at least one incorrect test case[1] as well, and I got 0 feedback on that one. I asked on the qualification page for clarification, and as far as I could tell, no questions were being answered, and mine was ignored along with the rest. [1] The Peg problem stated that there would be no ties, while the second example clearly had a tie. Again, they updated the tests, but only in the last 24 hours of the competition I believe, and with no notification to any of the competitors.
- gawker 16y agoYeah I feel your pain. I submitted a question. Time expired and after the round closed, it said I hadn't submitted anything and thus I am disqualified.