They are not all feed-forward unless it is some other definition that i am not aware of. Convolutional layers, XL hidden states, and graphical networks (which t

They are not all feed-forward unless it is some other definition that i am not aware of. Convolutional layers, XL hidden states, and graphical networks (which transformers are a special case of) aren't considered feedforward. Unless you consider the entire instance as a singular instance and don't use any hidden states, then I guess it could be considered feed-forward. I don't know. Feedforward doesn't seem like a useful term tbh. Some people mean feedforward as information only goes one direction, but that depends on your arrow. Autoregressive seems more useful here.