GPT-3 and descendants don't see numbers the way we do due to the unintuitive way the input is tokenized[1], and so we need to be careful about projecting unreas

GPT-3 and descendants don't see numbers the way we do due to the unintuitive way the input is tokenized[1], and so we need to be careful about projecting unreasonable expectations on what they should be able to do given their built-in limitations. [1] https://gwern.net/gpt-3#bpes https://gwern.net/gpt-3#bpes