7 ms·
I experimented with asking the models to rewrite text using odd and specific rules - “all sentences must start with the letter b and end with the letter d.” It
by pyuser583 4y ago
I experimented with asking the models to rewrite text using odd and specific rules - “all sentences must start with the letter b and end with the letter d.”
It was pretty good, but sometimes it wouldn’t even try. It would spit out a sentence that could have been easily rewritten to start with b and end with d - but it just didn’t.
These sorts of hallucinations are a big problem is high stakes practice.
- duskwuff 4y agoLLMs like GPT4 operate on tokens, not characters, so they're operating with a severe handicap when playing those sorts of games -- they see a word like "robot" as a single token, not as a collection of letters, so they don't know that it starts with the letter R unless that fact appeared in its training material. Interestingly, they do better at rhyming games, because those are based on associations between tokens which are easier to infer from usage in poetry, or by reading rhyming dictionaries.
- pyuser583 4y agoWhy was it able to still do a good job? The hallucinations were about 10%, but the rest often improved the original sentence, despite the silly rules? Also, wouldn’t learning from a dictionary make it pretty easy to know what word a letter starts with? Everything in chapter “B” starts with b.