4 ms·
What could be the use cases? Also visually it seems so simple, like for the Mish activation function https://github.com/digantamisra98/Mish/blob/master/README.m
by The_rationalist 6y ago
What could be the use cases?
Also visually it seems so simple, like for the Mish activation function https://github.com/digantamisra98/Mish/blob/master/README.md https://github.com/digantamisra98/Mish/blob/master/README.md
It seems to be advanced maths but I wonder why the designer (he already know in advance the desired form of the function in order to give him a desirable property (in both cases being more smoothed / continuous / centered)) does not draw graphically the desired function and let a software solve, find automatically the best approximation of the function?
EDIT: well it seems to be a general function approximator so my point doesn't apply (but still apply for the new activation functions in machine learning)