(DID NOT READ THE ENTIRE PAPER, only the abstract, the definition of the language and some of the experiments) Note sure how useful this is in the larger conte

(DID NOT READ THE ENTIRE PAPER, only the abstract, the definition of the language and some of the experiments) Note sure how useful this is in the larger context of transformers. Transformers (and deep networks in general) are often used when the logic to be used in solving a problem is largely unknown. Example -- How do you write a RASP program that identifies names in a document? They do have some simple RASP examples in the paper of things that a transformer model can accomplish (Symbolic Reasoning in Transformers) but, again, this is usually something that the model can do as a result of the task it was originally trained for, not a task in and of itself.