Part of what made the transformer so powerful when compared to RNNs and CNNs in NLP was the fact that they are highly parallelizable. That means you can optimiz

Part of what made the transformer so powerful when compared to RNNs and CNNs in NLP was the fact that they are highly parallelizable. That means you can optimize more parameters in the same amount of training time, which means you can model a more complex function.