3 ms·Doesn't really explain why not more typical ReLU + layer norm or some alternative.by lostmsu 3y agoDoesn't really explain why not more typical ReLU + layer norm or some alternative.