4 ms·
Yes, while I haven't done anything with ML myself, I heard via the 3Blue1Brown video on Deep Learning[0] that the sigmoid function isn't really that used anymor
by vanderZwan 9y ago
Yes, while I haven't done anything with ML myself, I heard via the 3Blue1Brown video on Deep Learning[0] that the sigmoid function isn't really that used anymore. But I figured allowing that being able to tweak the dynamic range could make it a good fit for the rescaling and recentering approach.
You know what, I'll just go ahead and post a link to this article on the Unum google group, perhaps someone there can add some thoughts[1].
[0] https://www.youtube.com/watch?v=aircAruvnKk&t=17m https://www.youtube.com/watch?v=aircAruvnKk&t=17m
[1]https://groups.google.com/forum/#!topic/unum-computing/RHrQUoyDl5c https://groups.google.com/forum/#!topic/unum-computing/RHrQU...
- dnautics 9y agoSigmoid is indeed hardly used as layer-to-layer transfer functions. But I gurantee you > 20% of the world is activating sigmoid functions in ML apps every day.
- vanderZwan 9y agoAh, thank you for that correction. Guess the video was accidentally misleading (they technically didn't say anything about other ML approaches, but overgeneralising like I did isn't that big of a leap)