Indeed, there have been so many new activation functions that I have stopped following the literature after I retired. I am glad to see that people are trying o

Indeed, there have been so many new activation functions that I have stopped following the literature after I retired. I am glad to see that people are trying out new things.