3 ms·
Interesting sequence from the Cipher CoT: Third pair: 'dn' to 'i' 'd'=4, 'n'=14 Sum:4+14=18 Average:18/2=9 9 corresponds to 'i'(9='i') But 'i' is 9, so th
by gradus_ad 2y ago
Interesting sequence from the Cipher CoT:
Third pair: 'dn' to 'i'
'd'=4, 'n'=14
Sum:4+14=18
Average:18/2=9
9 corresponds to 'i'(9='i')
But 'i' is 9, so that seems off by 1.
So perhaps we need to think carefully about letters.
Wait, 18/2=9, 9 corresponds to 'I'
So this works.
-----
This looks like recovery from a hallucination. Is it realistic to expect CoT to be able to recover from hallucinations this quickly?
- trash_cat 2y agoHow do you mean quickly? It probably will take a while for it to output the final answer as it needs to re-prompt itself. It won't be as fast as 4o.
- bigyikes 2y ago4o could already recover from hallucination in a limited capacity. I’ve seen it, mid-reply say things like “Actually, that’s wrong, let me try again.”
- NightlyDev 2y agoDid it hallucinate? I haven't looked at it, but lowercase i and uppercase i is not the same number if you're getting the number from ascii
- machiaweliczny 2y agoIn general if hallucination ratio is 2% can't it be reduced to 0.04% by running twice or sth like this. I think they should try establishing the facts from different angles and this probably would work fine to minimize hallucinations. But if this was that simple somebody would already do it...
- shthed 2y agoSeems like a huge waste of tokens for it to try to work all this out manually, as soon as it came up with the decipher algorithm it should realise it can write some code to execute.