3 ms·
In machine learning it's used as an activation function. Activation functions are used to add non-linearity to the model. I think sigmoid functions are inspired
by bno1 7y ago
In machine learning it's used as an activation function. Activation functions are used to add non-linearity to the model. I think sigmoid functions are inspired from neurons, but I'm not sure exactly how. Nowadays, ReLU activations are used more often than sigmoidals because they are quicker to compute.
- bno1 7y ago>I think sigmoid functions are inspired from neurons I mean the use of sigmoids as activations in NNs
- cmarschner 7y agoReLu are mainly used because in practice they show better results than sigmoids in many areas. The fact that they are also faster to compute is just a nice side effect.