Thanks! But, quadratic time complexity (which I had heard that attention requires, which doesn't surprise me) is not exponential time. I acknowledge that they

Thanks! But, quadratic time complexity (which I had heard that attention requires, which doesn't surprise me) is not exponential time. I acknowledge that they related this to the assumption of the SETH (which surprises me a little). But, this doesn't mean that transformers take exponential time. I don't think I understood what you meant by the "with a reduction in expressability" part of the statement, so maybe that is the reason behind me not following.