The trend in deep learning today is to train the same architecture for all tasks - the transformer, so it goes opposite to this work. But reducing the training

The trend in deep learning today is to train the same architecture for all tasks - the transformer, so it goes opposite to this work. But reducing the training cost would lower the barrier to access.