Author here: couldn't have put it better myself! Yes, the result isn't super surprising, but it helps strengthen the case for using Transformers for signal proc

Author here: couldn't have put it better myself! Yes, the result isn't super surprising, but it helps strengthen the case for using Transformers for signal processing and control. Also gives practical guidance on how such filters should be constructed (for example, how the embeddings should be chosen).