To be fair, the way inputs are tokenised does make per character operations much harder than you would expect. If OpenAI had instead made one character one toke

To be fair, the way inputs are tokenised does make per character operations much harder than you would expect. If OpenAI had instead made one character one token, then it would be worse in most senses (slower and less history) but would do much better at that kind of task.