4 ms·

That is a good summary, but it is a little bit more complex than what you have stated. But your comment is helpful because this is exactly the understanding tha

by __mtb__ 13y ago

That is a good summary, but it is a little bit more complex than what you have stated. But your comment is helpful because this is exactly the understanding that Goldbloom has and it is incorrect in an important way. The 23 entries that were submitted are for the public leaderboard set. The purpose of this set is so over the duration of the competition, competitors can see how they are performing relative to each other. These 23 submissions have no impact on the final prize winners. A different data set, called the final data set is what actually determines the final prize winners. I submitted this file exactly one time. It was processed and scored by Kaggle and I followed the directions exactly as the competition admin stated. I did not check a checkbox because I did not believe it applied - I only submitted a single file and I recieved the 'all zeros' response from Kaggle's system as it said it would. Also, the text Anthony quoted is not applicable to the Flight Quest competition either. This is the text that is used for the single phase competitions, not a two phase competition like Flight Quest. If you haven't competed before I know the difference might not be clear. But if you read the response from the other competitors in the forum, you can see there is general agreement that the submission page is faulty for a two phase competition.

frankacter 13y ago
Thanks for your reply and clarification. 1. So your stance is that Anthony, the CEO and Founder of Kaggle, is mistaken about the rules and execution of the 2 phase competition that his company is running, even after 8 days of his company communicating back and forth in email correspondence with you? 2. In the forum you initially state: "As I have been saying over email repeatedly over the past 8 days, and yesterday on the phone with you and the Sorkin, there is no checkbox to check!" ..then later state: "What on earth is a checkbox doing on the submission screen of a two phase competition? There is no ambiguity - there is only a single file type that is valid for the final leaderboard file. Why on earth is your software not smart enough to figure that out?" and later: "I submitted exactly one final submission. At this point the checkboxes should not matter" and in your reply above state: "I did not check a checkbox because I did not believe it applied" While I'm not familiar with all of the intricacies of the competition, conflicting statements like those have me a bit confused over this whole thing. 3. $30k is a lot of money, so I sympathize with you for missing out on that given that your algorithm is better than what the final results suggest. That being said, the other entrants that won competed using the same submission process that you did, was it just bad luck that your entry was not accepted in the manner you had expected or why did they not also encounter this submission bug? 4. Is this your first two phase competition with Kaggle? Was this competition executed different than other competitions? I ask as you seem surprised/confused about this "checkbox" that appears to be at the center of the controversy.
- __mtb__ 13y ago
  Thank you for reading the forum trying to better understand my POV. re: #1. Yes, my stance with Anthony is that he doesn't think there is a bug in the software because he thinks this is a typical one phase competition. Flight Quest was more complicated than the typical Kaggle competition. re: #2. I have done a poor job explaining the checkbox. I understand the confusion, as my statements are contradictory. In a single phase competition, the checkbox is important because over the course of the competition, numerous submissions are scored and you ultimately need to pick the one you want to apply as your final submission. In the case you do not make a final selection, the system selects the most recent submission. The same UI is used for the two phase competition, including the same text that Anthony posted in his response to me, however the submissions work slightly differently as I mentioned. > "As I have been saying over email repeatedly over the past 8 days, and yesterday on the phone with you and the Sorkin, there is no checkbox to check!" I said this because I don't believe there should have been a checkbox on the screen. That is what I meant by saying there is no checkbox to check.

by __mtb__ 13y ago

frankacter 13y ago

Thanks for your reply and clarification. 1. So your stance is that Anthony, the CEO and Founder of Kaggle, is mistaken about the rules and execution of the 2 phase competition that his company is running, even after 8 days of his company communicating back and forth in email correspondence with you? 2. In the forum you initially state: "As I have been saying over email repeatedly over the past 8 days, and yesterday on the phone with you and the Sorkin, there is no checkbox to check!" ..then later state: "What on earth is a checkbox doing on the submission screen of a two phase competition? There is no ambiguity - there is only a single file type that is valid for the final leaderboard file. Why on earth is your software not smart enough to figure that out?" and later: "I submitted exactly one final submission. At this point the checkboxes should not matter" and in your reply above state: "I did not check a checkbox because I did not believe it applied" While I'm not familiar with all of the intricacies of the competition, conflicting statements like those have me a bit confused over this whole thing. 3. $30k is a lot of money, so I sympathize with you for missing out on that given that your algorithm is better than what the final results suggest. That being said, the other entrants that won competed using the same submission process that you did, was it just bad luck that your entry was not accepted in the manner you had expected or why did they not also encounter this submission bug? 4. Is this your first two phase competition with Kaggle? Was this competition executed different than other competitions? I ask as you seem surprised/confused about this "checkbox" that appears to be at the center of the controversy.

__mtb__ 13y ago
Thank you for reading the forum trying to better understand my POV. re: #1. Yes, my stance with Anthony is that he doesn't think there is a bug in the software because he thinks this is a typical one phase competition. Flight Quest was more complicated than the typical Kaggle competition. re: #2. I have done a poor job explaining the checkbox. I understand the confusion, as my statements are contradictory. In a single phase competition, the checkbox is important because over the course of the competition, numerous submissions are scored and you ultimately need to pick the one you want to apply as your final submission. In the case you do not make a final selection, the system selects the most recent submission. The same UI is used for the two phase competition, including the same text that Anthony posted in his response to me, however the submissions work slightly differently as I mentioned. > "As I have been saying over email repeatedly over the past 8 days, and yesterday on the phone with you and the Sorkin, there is no checkbox to check!" I said this because I don't believe there should have been a checkbox on the screen. That is what I meant by saying there is no checkbox to check.