Actually this is only half true. Formal logic relies on words because some concepts, like finiteness, are impossible to grasp within the formalism itself. A goo

Actually this is only half true. Formal logic relies on words because some concepts, like finiteness, are impossible to grasp within the formalism itself. A good textbook on this is “Gödel's Theorems and Zermelo's Axioms A Firm Foundation of Mathematics”, which spends the early chapters dedicated to making you aware of this issue.