I mean unless you've got a better heuristic, but my conclusion is primarily structural with regard to Transformer units, basically that they're Turing-complete

I mean unless you've got a better heuristic, but my conclusion is primarily structural with regard to Transformer units, basically that they're Turing-complete -- if there's anything more to reasoning and abstraction, I don't know myself, perhaps Scott Aaronson is the guy to talk to.