4 ms·

I saw this yesterday. It’s very impressive, and a bit scary. I myself set my alarm early every morning (problems are dropped at 06:00) in my TimeZone. It woul

I saw this yesterday. It’s very impressive, and a bit scary. I myself set my alarm early every morning (problems are dropped at 06:00) in my TimeZone. It would be nice to only compete with other humans, but, I do understand that it would be impossible to enforce without totally changing AoC. I hope that we won’t see the competitive element of AoC disappear over the next couple of years as AI models get better and better at getting on the leaderboard. I’m not bitter, and I don’t want to stand in innovations way. I’m just a bit nostalgic and want AoC to stay the same:)

jodrellblank 4y ago
Earlier I was wondering what AoC would be like if it got rid of the time and instead the challenge was that you only get one chance to submit and get the right answer; what would people do differently in choice of language, test suites, fuzzing, reading, etc. But it seems GPT aced that as well.
- jchmrt 4y ago
  Why do you think GPT aced that? As far as I can tell from the code it sends in up to 10 guesses.
  - surfsvammel 4y ago
    If you submit a wrong answer, you cannot submit again in 60 seconds. I think that back-off time increases with every wrong submission. The AI has a finish time of 10s, meaning that it only submitted once (unless it is using multiple accounts to get around the back-off)
colonwqbang 4y ago
I'm expecting that the model will struggle once the problems start to get harder. The first few days of AOC are very trivial. To keep AoC competitive we would just need to start at a slightly higher difficulty.
- sixstringtheory 4y ago
  Which would raise the bar for newcomers and turn it into a GPT competition instead of a coding one.
  - Gigachad 4y ago
    Feels like AI is raising the bar on everything. Sure, you can draw better than AI, but it takes years of painstaking practice outputting work worse than a beginner with a prompt.
    - misja111 4y ago
      Give AI a couple more years and it will draw better than you anyway.
      - visarga 4y ago
        But it will be still you that initially has to intent to create something and manage the process. You got to manage AIs in order to do things. I bet in the future all corporate employees will be given access to a team of bots to manage their work.
        Gigachad 4y ago
        So basically the dull drone work remains but the actually rewarding things are being automated.
- misja111 4y ago
  I'm not so sure of that. I asked GPT to code an algorithm to find the shortest path in a graph and it had no trouble coding it using BFS.
  - yunwal 4y ago
    That also seems trivial. The model was likely trained on thousands of BFS implementations. Non-trivial is when the algorithm required to solve the problem is rare, or when the translation from word problem to algorithm is significant/requires other knowledge.

jodrellblank 4y ago

Earlier I was wondering what AoC would be like if it got rid of the time and instead the challenge was that you only get one chance to submit and get the right answer; what would people do differently in choice of language, test suites, fuzzing, reading, etc. But it seems GPT aced that as well.

jchmrt 4y ago
Why do you think GPT aced that? As far as I can tell from the code it sends in up to 10 guesses.
- surfsvammel 4y ago
  If you submit a wrong answer, you cannot submit again in 60 seconds. I think that back-off time increases with every wrong submission. The AI has a finish time of 10s, meaning that it only submitted once (unless it is using multiple accounts to get around the back-off)

colonwqbang 4y ago

I'm expecting that the model will struggle once the problems start to get harder. The first few days of AOC are very trivial. To keep AoC competitive we would just need to start at a slightly higher difficulty.

sixstringtheory 4y ago
Which would raise the bar for newcomers and turn it into a GPT competition instead of a coding one.
- Gigachad 4y ago
  Feels like AI is raising the bar on everything. Sure, you can draw better than AI, but it takes years of painstaking practice outputting work worse than a beginner with a prompt.
  - misja111 4y ago
    Give AI a couple more years and it will draw better than you anyway.
    - visarga 4y ago
      But it will be still you that initially has to intent to create something and manage the process. You got to manage AIs in order to do things. I bet in the future all corporate employees will be given access to a team of bots to manage their work.
      - Gigachad 4y ago
        So basically the dull drone work remains but the actually rewarding things are being automated.
misja111 4y ago
I'm not so sure of that. I asked GPT to code an algorithm to find the shortest path in a graph and it had no trouble coding it using BFS.
- yunwal 4y ago
  That also seems trivial. The model was likely trained on thousands of BFS implementations. Non-trivial is when the algorithm required to solve the problem is rare, or when the translation from word problem to algorithm is significant/requires other knowledge.