Oh, I want to clarify as well, that in talking about equivariances, I'm talking about the molecule generation side of things. So my main comment wasn't original

Oh, I want to clarify as well, that in talking about equivariances, I'm talking about the molecule generation side of things. So my main comment wasn't originally intending to get into textual language model stuff. Molecular dynamics is an entirely different beast that my best understanding is that it's quite difficult for a number of reasons.