3 ms·

Here's the creator of AoC saying the exact opposite on Reddit https://old.reddit.com/r/adventofcode/comments/18bp8id/why_does_aoc_care_about_llms/kc646i4/ https

Here's the creator of AoC saying the exact opposite on Reddit https://old.reddit.com/r/adventofcode/comments/18bp8id/why_does_aoc_care_about_llms/kc646i4/ https://old.reddit.com/r/adventofcode/comments/18bp8id/why_d... > Here are things LLMs didn't influence: > The story. > The puzzles. > The inputs. > I don't have a ChatGPT or Bard or whatever account, and I've never even used an LLM to write code or solve a puzzle, so I'm not sure what kinds of puzzles would be good or bad if that were my goal. Fortunately, it's not my goal - my goal is to help people become better programmers, not to create some kind of wacky LLM obstacle course. I'd rather have puzzles that are good for humans than puzzles that are both bad for humans and also somehow make the speed contest LLM-resistant. > I did the same thing this year that I do every year: I picked 25 puzzle ideas that sounded interesting to me, wrote them up, and then calibrated them based on betatester feedback. If you found a given puzzle easier or harder than you expected, please remember that difficulty is subjective and writing puzzles is tricky.

raincole 3y ago
Good example of "the best way to get a correct answer on the internet is to post a wrong one."
- fragmede 3y ago
  Poe's law strikes again!
maximus-decimus 3y ago
> calibrated them based on betatester feedback. At least one betatester might very well have been using chatgpt.
imjonse 3y ago
He may not have consciously written them to confuse LLMs but even without using any he probably knows they get more confused on reasoning tasks stated in not very clear text. At least for a few problem descriptions I couldn't help feeling that the statement was a lot more complex than it could have been and not only because of the story woven around it. Of course it could have been there to confuse the humans :)

raincole 3y ago

Good example of "the best way to get a correct answer on the internet is to post a wrong one."

fragmede 3y ago
Poe's law strikes again!

maximus-decimus 3y ago

> calibrated them based on betatester feedback. At least one betatester might very well have been using chatgpt.

imjonse 3y ago

He may not have consciously written them to confuse LLMs but even without using any he probably knows they get more confused on reasoning tasks stated in not very clear text. At least for a few problem descriptions I couldn't help feeling that the statement was a lot more complex than it could have been and not only because of the story woven around it. Of course it could have been there to confuse the humans :)