5 ms·
In lisp about 50% of the code is just closing parentheses.
by contravariant 2y ago
In lisp about 50% of the code is just closing parentheses.
- harry8 2y agoHeh, but it can't be that, no reason to think llms can count brackets needing a close any more than they can count words.
- overhead4075 2y agoLogically, it couldn't be 50% since that would imply that the other 50% would be open brackets and that would leave 0% room for macros.
- philipwhiuk 2y agoThat's just a rounding error ;)
- int_19h 2y agoLLMs can count words (and letters) just fine if you train them to do so. Consider the fact that GPT-4 can generate valid XML (meaning balanced tags, quotes etc) in base64-encoded form. Without CoT, just direct output.
- maleldil 2y agoThat's GPT-4, which you wouldn't use for in-line suggestions because it's too slow. I don't know what model Copilot uses these days, but it constantly makes bracket mistakes in Python.
- int_19h 2y agoYou don't need a GPT-4-sized model to count brackets. You just need to make sure that your training data includes enough cases like that for NN to learn it. My point is that GPT-4 can do much more complicated things than that, so there's nothing specific about LMs that preclude them from doing this kind of stuff right.
- deleted 2y ago[deleted]