4 ms·(x + √(x² + 1)) is a bit like a "soft relu". When x<0 it goes to zero. When x>0 it goes to 2x.by yobbo 2y ago(x + √(x² + 1)) is a bit like a "soft relu". When x<0 it goes to zero. When x>0 it goes to 2x.