12 ms·

I’ve actually had CAPS LOCK SCREAMING work better sometimes. Which boggles the mind but also makes sense?

• santiagobasulto 3y ago
  I was just looking at that! I know how these models work internally (), and I’d have said it’d not make a difference to use capslock. But then I see this prompt by OpenAI engineers and I’m like “they work then?” () I know the basics of ML, NLP, transformers, etc. I know the theory, not even remotely close to how they really work.
  • hack_edu 3y ago
    Words with capital letters typically have higher token counts. This causes the LLM to apply attention differently.
  • stavros 3y ago
    Why would it not make a difference to use Caps Lock? It's fairly universally used in English to show emphasis.