Sounds like a good test. We need something like this for "non-neural" things like transformers and normalization layers: https://proceedings.mlr.press/v157/sk

Sounds like a good test. We need something like this for "non-neural" things like transformers and normalization layers: https://proceedings.mlr.press/v157/skorski21a/skorski21a.pdf https://proceedings.mlr.press/v157/skorski21a/skorski21a.pdf