6 ms·
> For what it's worth, I've been using something similar with my prompts and felt the completions did a poor job of honoring this, but do a better job when aske
by dragonwriter 4y ago
> For what it's worth, I've been using something similar with my prompts and felt the completions did a poor job of honoring this, but do a better job when asked to use words instead of characters.
Yes, restricting by characters is hard for GPT-style LLMs because they work in tokens, not characters.
- kingo55 4y agoThanks, that's a good pickup -I'll refine my prompt.
- psychphysic 4y agoBut LLM have little concept of tokens don't they? Or at least well not know what their tokenizes is like.
- teaearlgraycold 4y agoIt can understand word boundaries, though. A space is its own token and there are special tokens for common words prefixed with a space or common word prefixes with a space in front, ex “ a”