4 ms·

I wonder what happens if you initialize the weights with these large outlier layers from the beginning.