It's funny that you think the way transformer models are "intended" to be used is the result of intentional engineering and not an accident that ML academics ar

It's funny that you think the way transformer models are "intended" to be used is the result of intentional engineering and not an accident that ML academics are no closer to giving some causal explanation for why it works today than they were when Attention is All You Need was published.