2 ms·

I mean, there's no real reason they shouldn't be able to do a backwards pass assuming they're using trivially differentiable activation functions.