3 ms·
There is a real issue with providing the contestant the real exact file that will be used in the contest. Because there are 1e9 shades of gray between hard codi
by camkego 3y ago
There is a real issue with providing the contestant the real exact file that will be used in the contest. Because there are 1e9 shades of gray between hard coding the correct answer in a single line program which doesn't even read the input, and processing the file as if we don't know what it contains.
This might become a contest of judging what is fair pre-computing and what is not.
That's why machine learning contests don't let participants see the final data.
- londons_explore 3y agoFix: A run consists of: * I generate random measurements with the provided script, which will be stored in a readonly file. * I run your program to calculate the results (and time it). * I run my baseline program and your entry is valid if my baseline program calculates the same results.
- lelanthran 3y agoThe filesystem has to be read-only as well, otherwise the first run can simply write the results to ~/.me_cheater and the program first reads that file before attempting to read the dataset.