4 ms·
That's really interesting, indeed I can reproduce this by changing the comment. I also managed to get correct output for this sample by renaming the function.
by doodlesdev 3y ago
That's really interesting, indeed I can reproduce this by changing the comment. I also managed to get correct output for this sample by renaming the function.
- eevilspock 3y agoclearly your original comment was unfair.
- int_19h 3y agoIs it, though? The major selling point of coding LLMs is that you can use natural language to describe what you want. If minor changes to wording - the ones that would not make any difference with a human - can result in drastically worse results, that feels problematic for real-world scenarios.
- throwaway675309 3y agoThe criticism stands if you have to continue to rewrite your "prompt" until you can coax out the correct desired output.