3 ms·
Author here: the point of the article was only to evaluate zero-shot capabilities. I’m certain that had I used LLMs I would have definitely gotten more stars on
by jerpint 2y ago
Author here: the point of the article was only to evaluate zero-shot capabilities. I’m certain that had I used LLMs I would have definitely gotten more stars on AoC (got 41/50 without). Because I chose to solve this year without LLMs, I was simply curious to see how the opposite setup would do, using basically zero human intervention to solve AoC.
That said, if I cared only to produce the best results I would 100% pair up with an LLM