3 ms·

Based on the leaderboard screenshot, only 7 people even solved up to day 12. The later days tend to be significantly harder than the early days. Based on top 10

Based on the leaderboard screenshot, only 7 people even solved up to day 12. The later days tend to be significantly harder than the early days. Based on top 100 leaderboard times, ~2x as hard for silver star.

brightball 3y ago
Yea, it gets tougher for sure. Everybody who participated seemed to enjoy solving the problems. Many of them have said they plan to solve the rest over the next couple of months, just not on the contest timeline.
encomiast 3y ago
Yeah this…the conclusion I would have drawn is not that the gold star took between 2-5 on average, but rather, 85% of people who self-select as enjoying a programming challenge where not able to finish more than half the tasks. Not that that's bad — seems slightly above par for the leaderboards I was involved in — just that the conclusion is really misleading.
- brightball 3y ago
  You’re free to draw your own conclusions of course. I can only tell you about the feedback I’ve gotten directly. Even people who didn’t complete any of the challenges have told me they plan to work them over the course of the year. We’re going to make this an annual thing and announce it at the next conference in August, so hopefully we will have more participants next year.
  - danbruc 3y ago
    Nothing will change the fact that the people participating in this challenge are not a representative sample of computer science graduates, hence an evaluation of their performance will not really tell much about what kind of performance one should expect from the average computer science graduate.
    - brightball 3y ago
      I will say that one of the guys who tied to win the competition is a 2021 Computer Science grad from Clemson. He's not a brand new grad, but that's the closest sample that I have.
      - Sharlin 3y ago
        There's still a huge selection effect. He could have been solving programming puzzles as a hobby for the past fifteen years for all we know, and his degree might have little to do with his AoC skills.
      - danbruc 3y ago
        The claim was that all computer science graduates should be able to solve those problems in a few hours each, the counter claim was that only one percent of them is capable to do so. The existence of one computer science graduates capable of winning the contest does not really tell us anything and I think nobody doubted that there are computer science graduates that are easily capable of solving such problems. But the question was or is, are they the exception or the norm?
        d0mine 3y ago
        The problems are essentially an elaborate IQ test (follow instructions, pay attention to the actual input, do some googling to get some polygon, graph algorithms/libraries). No deep knowledge is required. You don't need a CS degree for that. ~5% of those who solved the first 2 problems solved all 49 of them. Given that it is a significant time commitment to spend several hours per day every day for 25 days straight, more people could have done it, given the time. These are not some elite self-selected geniuses. 1/4 of those who solved 1st problem, hasn't solved the 2nd one despite its simplicity https://adventofcode.com/2023/stats https://adventofcode.com/2023/stats
        danbruc 3y ago
        This would also have been my opinion, computer science graduates should definitely be able to solve those problems in a few hours. The longest time to first solution this is year was something like 15 minutes, an hour or two for 100 correct solutions, so they are certainly not really hard problems. But personal opinion aside nobody provided any real evidence that this indeed the case and only that is what I wanted to point out in my comment.

brightball 3y ago

Yea, it gets tougher for sure. Everybody who participated seemed to enjoy solving the problems. Many of them have said they plan to solve the rest over the next couple of months, just not on the contest timeline.

encomiast 3y ago

Yeah this…the conclusion I would have drawn is not that the gold star took between 2-5 on average, but rather, 85% of people who self-select as enjoying a programming challenge where not able to finish more than half the tasks. Not that that's bad — seems slightly above par for the leaderboards I was involved in — just that the conclusion is really misleading.

brightball 3y ago
You’re free to draw your own conclusions of course. I can only tell you about the feedback I’ve gotten directly. Even people who didn’t complete any of the challenges have told me they plan to work them over the course of the year. We’re going to make this an annual thing and announce it at the next conference in August, so hopefully we will have more participants next year.
- danbruc 3y ago
  Nothing will change the fact that the people participating in this challenge are not a representative sample of computer science graduates, hence an evaluation of their performance will not really tell much about what kind of performance one should expect from the average computer science graduate.
  - brightball 3y ago
    I will say that one of the guys who tied to win the competition is a 2021 Computer Science grad from Clemson. He's not a brand new grad, but that's the closest sample that I have.
    - Sharlin 3y ago
      There's still a huge selection effect. He could have been solving programming puzzles as a hobby for the past fifteen years for all we know, and his degree might have little to do with his AoC skills.
    - danbruc 3y ago
      The claim was that all computer science graduates should be able to solve those problems in a few hours each, the counter claim was that only one percent of them is capable to do so. The existence of one computer science graduates capable of winning the contest does not really tell us anything and I think nobody doubted that there are computer science graduates that are easily capable of solving such problems. But the question was or is, are they the exception or the norm?
      - d0mine 3y ago
        The problems are essentially an elaborate IQ test (follow instructions, pay attention to the actual input, do some googling to get some polygon, graph algorithms/libraries). No deep knowledge is required. You don't need a CS degree for that. ~5% of those who solved the first 2 problems solved all 49 of them. Given that it is a significant time commitment to spend several hours per day every day for 25 days straight, more people could have done it, given the time. These are not some elite self-selected geniuses. 1/4 of those who solved 1st problem, hasn't solved the 2nd one despite its simplicity https://adventofcode.com/2023/stats https://adventofcode.com/2023/stats
        danbruc 3y ago
        This would also have been my opinion, computer science graduates should definitely be able to solve those problems in a few hours. The longest time to first solution this is year was something like 15 minutes, an hour or two for 100 correct solutions, so they are certainly not really hard problems. But personal opinion aside nobody provided any real evidence that this indeed the case and only that is what I wanted to point out in my comment.