3 ms·
> I Don't think we should be too hard on Baidu, considering they are attempting to improve their algorithm for the interest of humanity They are not improving
by netheril96 11y ago
> I Don't think we should be too hard on Baidu, considering they are attempting to improve their algorithm for the interest of humanity
They are not improving the algorithm for the interest of humanity. They submitted and obtained test results much more frequently than allowed. With that information, they can tune parameters to more closely fit the test data.
Basically it is like scoring higher on an exam where some of the questions have been leaked. It does not suggest you now have a better understanding of the subject.
- squigs25 11y agoIf they are building an algorithm which overfits to training data, their algorithm will lose performance on in the actual validation test. It is NOT like looking at leaked answers. It's like re-reading the textbook more than everyone else. Definitely an unfair advantage however.
- deleted 11y ago[deleted]
- varelse 11y agoYou misunderstand. They're using repeated attempts on the test set to improve their network. That is equivalent to training on the test set and that is unequivocably cheating.