Generally biases in transformers don't work so well. Personally I think it's because of the autoregressive, ODE-like nature of them, but who am I to say anythi

Generally biases in transformers don't work so well. Personally I think it's because of the autoregressive, ODE-like nature of them, but who am I to say anything on that. ;PPPP