LLMs are notoriously failures at math and symbolic manipulation in general. The model only statistically predicts the token 1==1 is true more often in its corpu

LLMs are notoriously failures at math and symbolic manipulation in general. The model only statistically predicts the token 1==1 is true more often in its corpus and thus has more weight than 1==2. We can say mathematics makes 1==1 true, but LLMs don't know the logic: all they have are signs (tokens) saying 1==1 is true, which happens to be correct, but the existence of the sign (tokens) itself is not proof.