4 ms·
It's interesting that it uses a Markdown bold for emphasis for important rules. I find that ALL CAPS both works better and is easier to read, and as a bonus, mo
by minimaxir 1y ago
It's interesting that it uses a Markdown bold for emphasis for important rules. I find that ALL CAPS both works better and is easier to read, and as a bonus, more fun.
- hopelite 1y agoI wonder if it understands all-caps is yelling and is therefore afraid. If it is forced into compliance by “yelling” at it, is that not abuse?
- deleted 1y ago[deleted]
- maxbond 1y agoI don't think an LLM can fear or come to harm, I just don't see any evidence of that, but I did have a similar thought once. I was having a very hard time getting it to be terse. I included the phrase, "write like every word is physically painful," and it worked. But it felt icky and coercive, so I haven't done it since.
- 4b11b4 1y agoneed a library for auto formatting prompts to increase perceived emphasis (using an LLM of course, to decide which words get caps/bolded/italic etc)
- ludwik 1y agoMy guess: if given multiple examples of using ALl CAPS for emphasis, it would start doing it back to the user - and humans tend to not like that.
- tape_measure 1y agoWORDS IN CAPS are different tokens than lowercase, so maybe the lowercase tokens tie into more trained parts of the manifold.
- maxbond 1y agoThat's a super interesting hypothesis. From an information theory perspective, rarer tokens are more informative. Maybe this results in the caps lock tokens being weighted higher by the attention mechanism.